Nov 14 04:47:38 user nova-compute[75469]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75469) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 04:47:38 user nova-compute[75469]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75469) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 04:47:38 user nova-compute[75469]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75469) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 04:47:38 user nova-compute[75469]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:47:39 user nova-compute[75469]: INFO nova.virt.driver [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 04:47:39 user nova-compute[75469]: INFO nova.compute.provider_config [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] Acquiring lock "singleton_lock" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] Acquired lock "singleton_lock" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] Releasing lock "singleton_lock" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] Full set of CONF: {{(pid=75469) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ******************************************************************************** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] Configuration options gathered from: {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ================================================================================ {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] allow_resize_to_same_host      = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] arq_binding_timeout            = 300 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] backdoor_port                  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] backdoor_socket                = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] block_device_allocate_retries  = 300 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] block_device_allocate_retries_interval = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cert                           = self.pem {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute_monitors               = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] config_dir                     = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] config_drive_format            = iso9660 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] config_source                  = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] console_host                   = user {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] control_exchange               = nova {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cpu_allocation_ratio           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] daemon                         = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] debug                          = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] default_access_ip_network_name = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] default_availability_zone      = nova {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] default_ephemeral_format       = ext4 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] default_green_pool_size        = 1000 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] default_schedule_zone          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] disk_allocation_ratio          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] enable_new_services            = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] enabled_ssl_apis               = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] flat_injected                  = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] force_config_drive             = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] force_raw_images               = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] graceful_shutdown_timeout      = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] heal_instance_info_cache_interval = 60 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] host                           = user {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] instance_build_timeout         = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] instance_delete_interval       = 300 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] instance_name_template         = instance-%08x {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] instance_usage_audit           = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] instance_usage_audit_period    = month {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] internal_service_availability_zone = internal {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] key                            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] live_migration_retry_count     = 30 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] log_config_append              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] log_dir                        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] log_file                       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] log_options                    = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] log_rotate_interval            = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] log_rotate_interval_type       = days {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] log_rotation_type              = none {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] long_rpc_timeout               = 1800 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] max_concurrent_builds          = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] max_concurrent_live_migrations = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] max_concurrent_snapshots       = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] max_local_block_devices        = 3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] max_logfile_count              = 30 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] max_logfile_size_mb            = 200 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] maximum_instance_delete_attempts = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] metadata_listen                = 0.0.0.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] metadata_listen_port           = 8775 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] metadata_workers               = 3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] migrate_max_retries            = -1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] mkisofs_cmd                    = genisoimage {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] my_ip                          = 10.0.0.210 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] network_allocate_retries       = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] osapi_compute_listen_port      = 8774 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] osapi_compute_unique_server_name_scope =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] osapi_compute_workers          = 3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] password_length                = 12 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] periodic_enable                = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] periodic_fuzzy_delay           = 60 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] pointer_model                  = ps2mouse {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] preallocate_images             = none {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] publish_errors                 = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] pybasedir                      = /opt/stack/nova {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ram_allocation_ratio           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] rate_limit_burst               = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] rate_limit_except_level        = CRITICAL {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] rate_limit_interval            = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] reboot_timeout                 = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] reclaim_instance_interval      = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] record                         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] reimage_timeout_per_gb         = 60 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] report_interval                = 120 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] rescue_timeout                 = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] reserved_host_cpus             = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] reserved_host_disk_mb          = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] reserved_host_memory_mb        = 512 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] reserved_huge_pages            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] resize_confirm_window          = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] resize_fs_using_block_device   = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] resume_guests_state_on_host_boot = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] rpc_response_timeout           = 60 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] run_external_periodic_tasks    = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] running_deleted_instance_action = reap {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] running_deleted_instance_timeout = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] scheduler_instance_sync_interval = 120 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] service_down_time              = 720 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] servicegroup_driver            = db {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] shelved_offload_time           = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] shelved_poll_interval          = 3600 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] shutdown_timeout               = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] source_is_ipv6                 = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ssl_only                       = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] state_path                     = /opt/stack/data/nova {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] sync_power_state_interval      = 600 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] sync_power_state_pool_size     = 1000 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] syslog_log_facility            = LOG_USER {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] tempdir                        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] timeout_nbd                    = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] transport_url                  = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] update_resources_interval      = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] use_cow_images                 = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] use_eventlog                   = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] use_journal                    = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] use_json                       = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] use_rootwrap_daemon            = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] use_stderr                     = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] use_syslog                     = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vcpu_pin_set                   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plugging_is_fatal          = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plugging_timeout           = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] virt_mkfs                      = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] volume_usage_poll_interval     = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] watch_log_file                 = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] web                            = /usr/share/spice-html5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_concurrency.disable_process_locking = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.auth_strategy              = keystone {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.compute_link_prefix        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.dhcp_domain                = novalocal {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.enable_instance_password   = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.glance_link_prefix         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.instance_list_per_project_cells = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.list_records_by_skipping_down_cells = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.local_metadata_per_cell    = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.max_limit                  = 1000 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.metadata_cache_expiration  = 15 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.neutron_default_tenant_id  = default {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.use_forwarded_for          = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.use_neutron_default_nets   = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.vendordata_dynamic_targets = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.vendordata_jsonfile_path   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.backend_argument         = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.config_prefix            = cache.oslo {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.dead_timeout             = 60.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.debug_cache_backend      = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.enable_retry_client      = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.enable_socket_keepalive  = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.enabled                  = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.expiration_time          = 600 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.hashclient_retry_attempts = 2 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.memcache_dead_retry      = 300 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.memcache_password        =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.memcache_sasl_enabled    = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.memcache_username        =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.proxies                  = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.retry_attempts           = 2 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.retry_delay              = 0.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.socket_keepalive_count   = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.socket_keepalive_idle    = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.socket_keepalive_interval = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.tls_allowed_ciphers      = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.tls_cafile               = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.tls_certfile             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.tls_enabled              = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cache.tls_keyfile              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.auth_section            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.auth_type               = password {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.cafile                  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.certfile                = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.collect_timing          = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.cross_az_attach         = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.debug                   = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.endpoint_template       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.http_retries            = 3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.insecure                = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.keyfile                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.os_region_name          = RegionOne {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.split_loggers           = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cinder.timeout                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.cpu_dedicated_set      = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.cpu_shared_set         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.image_type_exclude_list = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.resource_provider_association_refresh = 300 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.shutdown_retry_interval = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] conductor.workers              = 3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] console.allowed_origins        = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] console.ssl_ciphers            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] console.ssl_minimum_version    = default {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] consoleauth.token_ttl          = 600 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.cafile                  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.certfile                = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.collect_timing          = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.connect_retries         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.connect_retry_delay     = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.endpoint_override       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.insecure                = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.keyfile                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.max_version             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.min_version             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.region_name             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.service_name            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.service_type            = accelerator {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.split_loggers           = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.status_code_retries     = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.status_code_retry_delay = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.timeout                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] cyborg.version                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.backend               = sqlalchemy {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.connection            = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.connection_debug      = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.connection_parameters =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.connection_recycle_time = 3600 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.connection_trace      = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.db_inc_retry_interval = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.db_max_retries        = 20 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.db_max_retry_interval = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.db_retry_interval     = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.max_overflow          = 50 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.max_pool_size         = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.max_retries           = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.mysql_wsrep_sync_wait = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.pool_timeout          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.retry_interval        = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.slave_connection      = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] database.sqlite_synchronous    = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.backend           = sqlalchemy {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.connection        = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.connection_debug  = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.connection_parameters =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.connection_recycle_time = 3600 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.connection_trace  = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.db_inc_retry_interval = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.db_max_retries    = 20 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.db_max_retry_interval = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.db_retry_interval = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.max_overflow      = 50 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.max_pool_size     = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.max_retries       = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.pool_timeout      = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.retry_interval    = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.slave_connection  = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] api_database.sqlite_synchronous = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] devices.enabled_mdev_types     = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ephemeral_storage_encryption.enabled = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.api_servers             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.cafile                  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.certfile                = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.collect_timing          = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.connect_retries         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.connect_retry_delay     = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.debug                   = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.default_trusted_certificate_ids = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.enable_certificate_validation = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.enable_rbd_download     = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.endpoint_override       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.insecure                = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.keyfile                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.max_version             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.min_version             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.num_retries             = 3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.rbd_ceph_conf           =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.rbd_connect_timeout     = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.rbd_pool                =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.rbd_user                =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.region_name             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.service_name            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.service_type            = image {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.split_loggers           = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.status_code_retries     = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.status_code_retry_delay = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.timeout                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.verify_glance_signatures = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] glance.version                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] guestfs.debug                  = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.config_drive_cdrom      = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.config_drive_inject_password = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.enable_remotefx         = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.instances_path_share    =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.limit_cpu_features      = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.use_multipath_io        = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.vswitch_name            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] mks.enabled                    = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] image_cache.manager_interval   = 2400 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] image_cache.precache_concurrency = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] image_cache.remove_unused_base_images = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] image_cache.subdirectory_name  = _base {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.api_max_retries         = 60 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.api_retry_interval      = 2 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.auth_section            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.auth_type               = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.cafile                  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.certfile                = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.collect_timing          = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.conductor_group         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.connect_retries         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.connect_retry_delay     = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.endpoint_override       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.insecure                = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.keyfile                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.max_version             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.min_version             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.peer_list               = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.region_name             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.serial_console_state_timeout = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.service_name            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.service_type            = baremetal {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.split_loggers           = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.status_code_retries     = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.status_code_retry_delay = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.timeout                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ironic.version                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] key_manager.fixed_key          = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.barbican_api_version  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.barbican_endpoint     = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.barbican_endpoint_type = public {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.barbican_region_name  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.cafile                = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.certfile              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.collect_timing        = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.insecure              = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.keyfile               = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.number_of_retries     = 60 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.retry_delay           = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.send_service_user_token = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.split_loggers         = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.timeout               = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.verify_ssl            = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican.verify_ssl_path       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican_service_user.auth_section = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican_service_user.auth_type = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican_service_user.cafile   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican_service_user.certfile = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican_service_user.collect_timing = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican_service_user.insecure = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican_service_user.keyfile  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican_service_user.split_loggers = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] barbican_service_user.timeout  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.approle_role_id          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.approle_secret_id        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.cafile                   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.certfile                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.collect_timing           = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.insecure                 = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.keyfile                  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.kv_mountpoint            = secret {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.kv_path                  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.kv_version               = 2 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.namespace                = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.root_token_id            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.split_loggers            = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.ssl_ca_crt_file          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.timeout                  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.use_ssl                  = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.auth_section          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.auth_type             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.cafile                = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.certfile              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.collect_timing        = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.connect_retries       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.connect_retry_delay   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.endpoint_override     = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.insecure              = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.keyfile               = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.max_version           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.min_version           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.region_name           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.service_name          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.service_type          = identity {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.split_loggers         = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.status_code_retries   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.status_code_retry_delay = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.timeout               = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] keystone.version               = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.connection_uri         =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.cpu_mode               = custom {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: WARNING oslo_config.cfg [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.cpu_power_governor_high = performance {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.cpu_power_management   = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.device_detach_attempts = 8 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.device_detach_timeout  = 20 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.disk_cachemodes        = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.disk_prefix            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.enabled_perf_events    = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.file_backed_memory     = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.gid_maps               = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.hw_disk_discard        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.hw_machine_type        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.images_rbd_pool        = rbd {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.images_type            = default {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.images_volume_group    = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.inject_key             = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.inject_partition       = -2 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.inject_password        = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.iscsi_iface            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.iser_use_multipath     = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_downtime = 500 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_inbound_addr = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_scheme  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_timeout_action = abort {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_tunnelled = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: WARNING oslo_config.cfg [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 04:47:39 user nova-compute[75469]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 04:47:39 user nova-compute[75469]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 04:47:39 user nova-compute[75469]: and ``live_migration_inbound_addr`` respectively.
Nov 14 04:47:39 user nova-compute[75469]: ).  Its value may be silently ignored in the future.
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.live_migration_with_native_tls = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.max_queues             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.nfs_mount_options      = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.num_pcie_ports         = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.pmem_namespaces        = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.quobyte_client_cfg     = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.rbd_secret_uuid        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.rbd_user               = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.rescue_image_id        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.rescue_kernel_id       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.rx_queue_size          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.smbfs_mount_options    =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.snapshot_compression   = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.snapshot_image_format  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.sparse_logical_volumes = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.swtpm_enabled          = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.swtpm_group            = tss {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.swtpm_user             = tss {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.sysinfo_serial         = unique {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.tb_cache_size          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.tx_queue_size          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.uid_maps               = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.use_virtio_for_bridges = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.virt_type              = kvm {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.volume_clear           = zero {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.volume_clear_size      = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.volume_use_multipath   = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.vzstorage_cache_path   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.auth_section           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.auth_type              = password {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.cafile                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.certfile               = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.collect_timing         = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.connect_retries        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.connect_retry_delay    = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.default_floating_pool  = public {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.endpoint_override      = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.extension_sync_interval = 600 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.http_retries           = 3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.insecure               = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.keyfile                = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.max_version            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.min_version            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.ovs_bridge             = br-int {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.physnets               = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.region_name            = RegionOne {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.service_metadata_proxy = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.service_name           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.service_type           = network {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.split_loggers          = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.status_code_retries    = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.status_code_retry_delay = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.timeout                = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] neutron.version                = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] notifications.bdms_in_notifications = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] notifications.default_level    = INFO {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] notifications.notification_format = unversioned {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] notifications.notify_on_state_change = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] pci.alias                      = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] pci.device_spec                = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] pci.report_in_placement        = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.auth_section         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.auth_type            = password {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.cafile               = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.certfile             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.collect_timing       = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.connect_retries      = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.connect_retry_delay  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.default_domain_id    = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.default_domain_name  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.domain_id            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.domain_name          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.endpoint_override    = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.insecure             = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.keyfile              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.max_version          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.min_version          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.password             = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.project_domain_id    = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.project_domain_name  = Default {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.project_id           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.project_name         = service {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.region_name          = RegionOne {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.service_name         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.service_type         = placement {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.split_loggers        = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.status_code_retries  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.status_code_retry_delay = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.system_scope         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.timeout              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.trust_id             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.user_domain_id       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.user_domain_name     = Default {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.user_id              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.username             = placement {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] placement.version              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.cores                    = 20 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.count_usage_from_placement = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.injected_file_content_bytes = 10240 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.injected_file_path_length = 255 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.injected_files           = 5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.instances                = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.key_pairs                = 100 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.metadata_items           = 128 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.ram                      = 51200 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.recheck_quota            = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.server_group_members     = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] quota.server_groups            = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] rdp.enabled                    = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] scheduler.image_metadata_prefilter = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] scheduler.max_attempts         = 3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] scheduler.max_placement_results = 1000 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] scheduler.workers              = 3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.host_subset_size = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.isolated_hosts = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.isolated_images = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.pci_in_placement = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.track_instance_changes = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] metrics.required               = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] metrics.weight_multiplier      = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] metrics.weight_setting         = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] serial_console.enabled         = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] serial_console.port_range      = 10000:20000 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] serial_console.serialproxy_port = 6083 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] service_user.auth_section      = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] service_user.auth_type         = password {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] service_user.cafile            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] service_user.certfile          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] service_user.collect_timing    = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] service_user.insecure          = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] service_user.keyfile           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] service_user.send_service_user_token = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] service_user.split_loggers     = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] service_user.timeout           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.agent_enabled            = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.enabled                  = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.html5proxy_port          = 6082 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.image_compression        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.jpeg_compression         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.playback_compression     = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.server_listen            = 127.0.0.1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.streaming_mode           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] spice.zlib_compression         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] upgrade_levels.baseapi         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] upgrade_levels.cert            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] upgrade_levels.compute         = auto {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] upgrade_levels.conductor       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] upgrade_levels.scheduler       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vendordata_dynamic_auth.cafile = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vendordata_dynamic_auth.certfile = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vendordata_dynamic_auth.insecure = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vendordata_dynamic_auth.timeout = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.api_retry_count         = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.ca_file                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.cache_prefix            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.cluster_name            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.connection_pool_size    = 10 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.console_delay_seconds   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.datastore_regex         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.host_ip                 = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.host_password           = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.host_port               = 443 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.host_username           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.insecure                = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.integration_bridge      = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.maximum_objects         = 100 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.pbm_default_policy      = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.pbm_enabled             = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.pbm_wsdl_location       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.serial_port_proxy_uri   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.serial_port_service_uri = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.task_poll_interval      = 0.5 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.use_linked_clone        = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.vnc_keymap              = en-us {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.vnc_port                = 5900 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vmware.vnc_port_total          = 10000 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vnc.auth_schemes               = ['none'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vnc.enabled                    = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vnc.novncproxy_port            = 6080 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vnc.vencrypt_ca_certs          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vnc.vencrypt_client_cert       = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vnc.vencrypt_client_key        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.disable_rootwrap   = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.enable_numa_live_migration = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.libvirt_disable_apic = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] wsgi.client_socket_timeout     = 900 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] wsgi.default_pool_size         = 1000 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] wsgi.keep_alive                = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] wsgi.max_header_line           = 16384 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] wsgi.ssl_ca_file               = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] wsgi.ssl_cert_file             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] wsgi.ssl_key_file              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] wsgi.tcp_keepidle              = 600 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] zvm.ca_file                    = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] zvm.cloud_connector_url        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] zvm.reachable_timeout          = 300 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_policy.enforce_new_defaults = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_policy.enforce_scope      = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_policy.policy_default_rule = default {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler.connection_string     = messaging:// {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler.enabled               = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler.es_doc_type           = notification {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler.es_scroll_size        = 10000 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler.es_scroll_time        = 2m {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler.filter_error_trace    = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler.hmac_keys             = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler.sentinel_service_name = mymaster {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler.socket_timeout        = 0.1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler.trace_requests        = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler.trace_sqlalchemy      = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler_jaeger.process_tags   = {} {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler_jaeger.service_name_prefix = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] profiler_otlp.service_name_prefix = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] remote_debug.host              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] remote_debug.port              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_notifications.retry = -1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.auth_section        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.auth_type           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.cafile              = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.certfile            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.collect_timing      = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.connect_retries     = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.connect_retry_delay = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.endpoint_id         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.endpoint_override   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.insecure            = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.keyfile             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.max_version         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.min_version         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.region_name         = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.service_name        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.service_type        = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.split_loggers       = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.status_code_retries = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.status_code_retry_delay = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.timeout             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.valid_interfaces    = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_limit.version             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_reports.file_event_handler = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] oslo_reports.log_dir           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_ovs_privileged.group  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] vif_plug_ovs_privileged.user   = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_ovs.isolate_vif         = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] os_brick.lock_path             = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] privsep_osbrick.capabilities   = [21] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] privsep_osbrick.group          = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] privsep_osbrick.helper_command = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] privsep_osbrick.user           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] nova_sys_admin.group           = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] nova_sys_admin.helper_command  = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] nova_sys_admin.user            = None {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG oslo_service.service [None req-20690e7a-d5a1-4b09-a13c-2257d2643578 None None] ******************************************************************************** {{(pid=75469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 04:47:39 user nova-compute[75469]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 04:47:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Connecting to libvirt: qemu:///system {{(pid=75469) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa7505df010> {{(pid=75469) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 04:47:39 user nova-compute[75469]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 04:47:39 user nova-compute[75469]: WARNING nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 04:47:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa7505df010> {{(pid=75469) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Starting native event thread {{(pid=75469) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Starting green dispatch thread {{(pid=75469) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 04:47:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Starting connection event dispatch thread {{(pid=75469) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 04:47:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Connection event '1' reason 'None'
Nov 14 04:47:39 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 04:47:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.mount [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Initialising _HostMountState generation 0 {{(pid=75469) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 04:47:47 user nova-compute[75469]: INFO nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Libvirt host capabilities <capabilities>
Nov 14 04:47:47 user nova-compute[75469]:   <host>
Nov 14 04:47:47 user nova-compute[75469]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 04:47:47 user nova-compute[75469]:     <cpu>
Nov 14 04:47:47 user nova-compute[75469]:       <arch>x86_64</arch>
Nov 14 04:47:47 user nova-compute[75469]:       <model>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <vendor>Intel</vendor>
Nov 14 04:47:47 user nova-compute[75469]:       <microcode version='1070'/>
Nov 14 04:47:47 user nova-compute[75469]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 04:47:47 user nova-compute[75469]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='ss'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='vmx'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='pcid'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='osxsave'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='hypervisor'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='arat'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='tsc_adjust'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='md-clear'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='arch-capabilities'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='invtsc'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='rsba'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 04:47:47 user nova-compute[75469]:       <pages unit='KiB' size='4'/>
Nov 14 04:47:47 user nova-compute[75469]:       <pages unit='KiB' size='2048'/>
Nov 14 04:47:47 user nova-compute[75469]:     </cpu>
Nov 14 04:47:47 user nova-compute[75469]:     <power_management>
Nov 14 04:47:47 user nova-compute[75469]:       <suspend_mem/>
Nov 14 04:47:47 user nova-compute[75469]:       <suspend_disk/>
Nov 14 04:47:47 user nova-compute[75469]:       <suspend_hybrid/>
Nov 14 04:47:47 user nova-compute[75469]:     </power_management>
Nov 14 04:47:47 user nova-compute[75469]:     <iommu support='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     <migration_features>
Nov 14 04:47:47 user nova-compute[75469]:       <live/>
Nov 14 04:47:47 user nova-compute[75469]:       <uri_transports>
Nov 14 04:47:47 user nova-compute[75469]:         <uri_transport>tcp</uri_transport>
Nov 14 04:47:47 user nova-compute[75469]:         <uri_transport>rdma</uri_transport>
Nov 14 04:47:47 user nova-compute[75469]:       </uri_transports>
Nov 14 04:47:47 user nova-compute[75469]:     </migration_features>
Nov 14 04:47:47 user nova-compute[75469]:     <topology>
Nov 14 04:47:47 user nova-compute[75469]:       <cells num='2'>
Nov 14 04:47:47 user nova-compute[75469]:         <cell id='0'>
Nov 14 04:47:47 user nova-compute[75469]:           <memory unit='KiB'>8140616</memory>
Nov 14 04:47:47 user nova-compute[75469]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 14 04:47:47 user nova-compute[75469]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 04:47:47 user nova-compute[75469]:           <distances>
Nov 14 04:47:47 user nova-compute[75469]:             <sibling id='0' value='10'/>
Nov 14 04:47:47 user nova-compute[75469]:             <sibling id='1' value='20'/>
Nov 14 04:47:47 user nova-compute[75469]:           </distances>
Nov 14 04:47:47 user nova-compute[75469]:           <cpus num='6'>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 04:47:47 user nova-compute[75469]:           </cpus>
Nov 14 04:47:47 user nova-compute[75469]:         </cell>
Nov 14 04:47:47 user nova-compute[75469]:         <cell id='1'>
Nov 14 04:47:47 user nova-compute[75469]:           <memory unit='KiB'>8255068</memory>
Nov 14 04:47:47 user nova-compute[75469]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 14 04:47:47 user nova-compute[75469]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 04:47:47 user nova-compute[75469]:           <distances>
Nov 14 04:47:47 user nova-compute[75469]:             <sibling id='0' value='20'/>
Nov 14 04:47:47 user nova-compute[75469]:             <sibling id='1' value='10'/>
Nov 14 04:47:47 user nova-compute[75469]:           </distances>
Nov 14 04:47:47 user nova-compute[75469]:           <cpus num='6'>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 04:47:47 user nova-compute[75469]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 04:47:47 user nova-compute[75469]:           </cpus>
Nov 14 04:47:47 user nova-compute[75469]:         </cell>
Nov 14 04:47:47 user nova-compute[75469]:       </cells>
Nov 14 04:47:47 user nova-compute[75469]:     </topology>
Nov 14 04:47:47 user nova-compute[75469]:     <cache>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 04:47:47 user nova-compute[75469]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 04:47:47 user nova-compute[75469]:     </cache>
Nov 14 04:47:47 user nova-compute[75469]:     <secmodel>
Nov 14 04:47:47 user nova-compute[75469]:       <model>apparmor</model>
Nov 14 04:47:47 user nova-compute[75469]:       <doi>0</doi>
Nov 14 04:47:47 user nova-compute[75469]:     </secmodel>
Nov 14 04:47:47 user nova-compute[75469]:     <secmodel>
Nov 14 04:47:47 user nova-compute[75469]:       <model>dac</model>
Nov 14 04:47:47 user nova-compute[75469]:       <doi>0</doi>
Nov 14 04:47:47 user nova-compute[75469]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 04:47:47 user nova-compute[75469]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 04:47:47 user nova-compute[75469]:     </secmodel>
Nov 14 04:47:47 user nova-compute[75469]:   </host>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='alpha'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>64</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>clipper</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='armv6l'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>spitz</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>nuri</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>kzm</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sx1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>z2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>tosa</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>n810</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>n800</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>terrier</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>midway</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>microbit</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>verdex</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>highbank</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>akita</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>connex</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>collie</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='armv7l'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>spitz</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>nuri</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>kzm</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sx1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>z2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>tosa</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>n810</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>n800</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>terrier</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>midway</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>microbit</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>verdex</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>highbank</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>akita</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>connex</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>collie</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='aarch64'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>64</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>spitz</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>nuri</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>kzm</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sx1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>z2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>tosa</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>n810</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>n800</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>terrier</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>midway</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>microbit</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>verdex</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>highbank</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>akita</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>connex</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>collie</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <acpi default='on' toggle='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='cris'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='i686'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>isapc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>microvm</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='kvm'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <pae/>
Nov 14 04:47:47 user nova-compute[75469]:       <nonpae/>
Nov 14 04:47:47 user nova-compute[75469]:       <acpi default='on' toggle='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:       <apic default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='m68k'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>an5206</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>q800</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='microblaze'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='microblazeel'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='mips'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='16'>malta</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='mipsel'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='16'>malta</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='mips64'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>64</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='16'>malta</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>pica61</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>magnum</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='mips64el'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>64</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='16'>malta</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>pica61</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>magnum</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='16'>boston</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='ppc'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mac99</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>40p</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>taihu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='ppc64'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>64</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>taihu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>40p</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mac99</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='ppc64le'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>64</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>taihu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>40p</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>mac99</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='riscv32'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='8'>spike</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='8'>virt</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='riscv64'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>64</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='8'>spike</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='8'>virt</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='s390x'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>64</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='sh4'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>shix</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>r2d</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='sh4eb'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>64</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>shix</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>r2d</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='sparc'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>LX</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='sparc64'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>64</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>niagara</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='x86_64'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>64</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='1'>isapc</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>microvm</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='kvm'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <acpi default='on' toggle='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:       <apic default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='xtensa'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>sim</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>kc705</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>ml605</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>virt</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>lx200</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>lx60</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]:   <guest>
Nov 14 04:47:47 user nova-compute[75469]:     <os_type>hvm</os_type>
Nov 14 04:47:47 user nova-compute[75469]:     <arch name='xtensaeb'>
Nov 14 04:47:47 user nova-compute[75469]:       <wordsize>32</wordsize>
Nov 14 04:47:47 user nova-compute[75469]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='4'>sim</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>kc705</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>ml605</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>virt</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>lx200</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>lx60</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 04:47:47 user nova-compute[75469]:       <domain type='qemu'/>
Nov 14 04:47:47 user nova-compute[75469]:     </arch>
Nov 14 04:47:47 user nova-compute[75469]:     <features>
Nov 14 04:47:47 user nova-compute[75469]:       <cpuselection/>
Nov 14 04:47:47 user nova-compute[75469]:       <deviceboot/>
Nov 14 04:47:47 user nova-compute[75469]:       <disksnapshot default='on' toggle='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     </features>
Nov 14 04:47:47 user nova-compute[75469]:   </guest>
Nov 14 04:47:47 user nova-compute[75469]: </capabilities>
Nov 14 04:47:47 user nova-compute[75469]: 
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 04:47:47 user nova-compute[75469]: <domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 04:47:47 user nova-compute[75469]:   <domain>kvm</domain>
Nov 14 04:47:47 user nova-compute[75469]:   <machine>pc-q35-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:   <arch>i686</arch>
Nov 14 04:47:47 user nova-compute[75469]:   <vcpu max='288'/>
Nov 14 04:47:47 user nova-compute[75469]:   <iothreads supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:   <os supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='firmware'/>
Nov 14 04:47:47 user nova-compute[75469]:     <loader supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>rom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pflash</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='readonly'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>yes</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='secure'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </loader>
Nov 14 04:47:47 user nova-compute[75469]:   </os>
Nov 14 04:47:47 user nova-compute[75469]:   <cpu>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-passthrough' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='hostPassthroughMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='maximum' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='maximumMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-model' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <vendor>Intel</vendor>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ss'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='vmx'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pcid'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='hypervisor'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arat'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='umip'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='md-clear'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibpb'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibrs'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='erms'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='lm'/>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='custom' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>qemu64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>qemu32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>phenom</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>n270</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>kvm64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>coreduo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>core2duo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>athlon</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Westmere</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Snowridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Penryn</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G5</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G4</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G1</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Nehalem</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Rome</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Milan</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Dhyana</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cooperlake</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Conroe</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>486</model>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:   </cpu>
Nov 14 04:47:47 user nova-compute[75469]:   <memoryBacking supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='sourceType'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>file</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>anonymous</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>memfd</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:   </memoryBacking>
Nov 14 04:47:47 user nova-compute[75469]:   <devices>
Nov 14 04:47:47 user nova-compute[75469]:     <disk supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='diskDevice'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>disk</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cdrom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>floppy</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>lun</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='bus'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>fdc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sata</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </disk>
Nov 14 04:47:47 user nova-compute[75469]:     <graphics supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sdl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vnc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>spice</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egl-headless</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </graphics>
Nov 14 04:47:47 user nova-compute[75469]:     <video supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='modelType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cirrus</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vmvga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>qxl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>none</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>bochs</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ramfb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </video>
Nov 14 04:47:47 user nova-compute[75469]:     <hostdev supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='mode'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>subsystem</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='startupPolicy'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>default</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>mandatory</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>requisite</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>optional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='subsysType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pci</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='capsType'/>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='pciBackend'/>
Nov 14 04:47:47 user nova-compute[75469]:     </hostdev>
Nov 14 04:47:47 user nova-compute[75469]:     <rng supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>random</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egd</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>builtin</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </rng>
Nov 14 04:47:47 user nova-compute[75469]:     <filesystem supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='driverType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>path</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>handle</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtiofs</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </filesystem>
Nov 14 04:47:47 user nova-compute[75469]:     <tpm supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-tis</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-crb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>passthrough</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>emulator</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </tpm>
Nov 14 04:47:47 user nova-compute[75469]:   </devices>
Nov 14 04:47:47 user nova-compute[75469]:   <features>
Nov 14 04:47:47 user nova-compute[75469]:     <gic supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     <vmcoreinfo supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <genid supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backingStoreInput supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backup supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <sev supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:   </features>
Nov 14 04:47:47 user nova-compute[75469]: </domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:  {{(pid=75469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 04:47:47 user nova-compute[75469]: <domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 04:47:47 user nova-compute[75469]:   <domain>kvm</domain>
Nov 14 04:47:47 user nova-compute[75469]:   <machine>pc-i440fx-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:   <arch>i686</arch>
Nov 14 04:47:47 user nova-compute[75469]:   <vcpu max='255'/>
Nov 14 04:47:47 user nova-compute[75469]:   <iothreads supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:   <os supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='firmware'/>
Nov 14 04:47:47 user nova-compute[75469]:     <loader supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>rom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pflash</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='readonly'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>yes</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='secure'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </loader>
Nov 14 04:47:47 user nova-compute[75469]:   </os>
Nov 14 04:47:47 user nova-compute[75469]:   <cpu>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-passthrough' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='hostPassthroughMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='maximum' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='maximumMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-model' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <vendor>Intel</vendor>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ss'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='vmx'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pcid'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='hypervisor'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arat'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='umip'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='md-clear'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibpb'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibrs'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='erms'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='lm'/>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='custom' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>qemu64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>qemu32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>phenom</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>n270</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>kvm64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>coreduo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>core2duo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>athlon</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Westmere</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Snowridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Penryn</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G5</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G4</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G1</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Nehalem</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Rome</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Milan</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Dhyana</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cooperlake</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Conroe</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>486</model>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:   </cpu>
Nov 14 04:47:47 user nova-compute[75469]:   <memoryBacking supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='sourceType'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>file</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>anonymous</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>memfd</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:   </memoryBacking>
Nov 14 04:47:47 user nova-compute[75469]:   <devices>
Nov 14 04:47:47 user nova-compute[75469]:     <disk supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='diskDevice'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>disk</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cdrom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>floppy</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>lun</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='bus'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ide</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>fdc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sata</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </disk>
Nov 14 04:47:47 user nova-compute[75469]:     <graphics supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sdl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vnc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>spice</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egl-headless</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </graphics>
Nov 14 04:47:47 user nova-compute[75469]:     <video supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='modelType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cirrus</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vmvga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>qxl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>none</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>bochs</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ramfb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </video>
Nov 14 04:47:47 user nova-compute[75469]:     <hostdev supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='mode'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>subsystem</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='startupPolicy'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>default</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>mandatory</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>requisite</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>optional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='subsysType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pci</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='capsType'/>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='pciBackend'/>
Nov 14 04:47:47 user nova-compute[75469]:     </hostdev>
Nov 14 04:47:47 user nova-compute[75469]:     <rng supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>random</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egd</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>builtin</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </rng>
Nov 14 04:47:47 user nova-compute[75469]:     <filesystem supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='driverType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>path</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>handle</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtiofs</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </filesystem>
Nov 14 04:47:47 user nova-compute[75469]:     <tpm supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-tis</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-crb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>passthrough</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>emulator</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </tpm>
Nov 14 04:47:47 user nova-compute[75469]:   </devices>
Nov 14 04:47:47 user nova-compute[75469]:   <features>
Nov 14 04:47:47 user nova-compute[75469]:     <gic supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     <vmcoreinfo supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <genid supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backingStoreInput supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backup supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <sev supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:   </features>
Nov 14 04:47:47 user nova-compute[75469]: </domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:  {{(pid=75469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 04:47:47 user nova-compute[75469]: <domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 04:47:47 user nova-compute[75469]:   <domain>kvm</domain>
Nov 14 04:47:47 user nova-compute[75469]:   <machine>pc-q35-jammy</machine>
Nov 14 04:47:47 user nova-compute[75469]:   <arch>i686</arch>
Nov 14 04:47:47 user nova-compute[75469]:   <vcpu max='288'/>
Nov 14 04:47:47 user nova-compute[75469]:   <iothreads supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:   <os supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='firmware'/>
Nov 14 04:47:47 user nova-compute[75469]:     <loader supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>rom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pflash</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='readonly'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>yes</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='secure'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </loader>
Nov 14 04:47:47 user nova-compute[75469]:   </os>
Nov 14 04:47:47 user nova-compute[75469]:   <cpu>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-passthrough' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='hostPassthroughMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='maximum' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='maximumMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-model' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <vendor>Intel</vendor>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ss'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='vmx'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pcid'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='hypervisor'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arat'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='umip'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='md-clear'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibpb'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibrs'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='erms'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='lm'/>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='custom' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>qemu64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>qemu32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>phenom</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>n270</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>kvm64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>coreduo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>core2duo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>athlon</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Westmere</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Snowridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Penryn</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G5</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G4</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G1</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Nehalem</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Rome</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Milan</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Dhyana</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cooperlake</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Conroe</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>486</model>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:   </cpu>
Nov 14 04:47:47 user nova-compute[75469]:   <memoryBacking supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='sourceType'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>file</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>anonymous</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>memfd</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:   </memoryBacking>
Nov 14 04:47:47 user nova-compute[75469]:   <devices>
Nov 14 04:47:47 user nova-compute[75469]:     <disk supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='diskDevice'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>disk</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cdrom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>floppy</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>lun</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='bus'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>fdc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sata</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </disk>
Nov 14 04:47:47 user nova-compute[75469]:     <graphics supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sdl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vnc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>spice</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egl-headless</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </graphics>
Nov 14 04:47:47 user nova-compute[75469]:     <video supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='modelType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cirrus</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vmvga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>qxl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>none</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>bochs</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ramfb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </video>
Nov 14 04:47:47 user nova-compute[75469]:     <hostdev supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='mode'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>subsystem</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='startupPolicy'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>default</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>mandatory</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>requisite</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>optional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='subsysType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pci</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='capsType'/>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='pciBackend'/>
Nov 14 04:47:47 user nova-compute[75469]:     </hostdev>
Nov 14 04:47:47 user nova-compute[75469]:     <rng supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>random</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egd</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>builtin</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </rng>
Nov 14 04:47:47 user nova-compute[75469]:     <filesystem supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='driverType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>path</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>handle</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtiofs</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </filesystem>
Nov 14 04:47:47 user nova-compute[75469]:     <tpm supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-tis</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-crb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>passthrough</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>emulator</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </tpm>
Nov 14 04:47:47 user nova-compute[75469]:   </devices>
Nov 14 04:47:47 user nova-compute[75469]:   <features>
Nov 14 04:47:47 user nova-compute[75469]:     <gic supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     <vmcoreinfo supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <genid supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backingStoreInput supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backup supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <sev supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:   </features>
Nov 14 04:47:47 user nova-compute[75469]: </domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:  {{(pid=75469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 04:47:47 user nova-compute[75469]: <domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 04:47:47 user nova-compute[75469]:   <domain>kvm</domain>
Nov 14 04:47:47 user nova-compute[75469]:   <machine>pc-i440fx-jammy</machine>
Nov 14 04:47:47 user nova-compute[75469]:   <arch>i686</arch>
Nov 14 04:47:47 user nova-compute[75469]:   <vcpu max='255'/>
Nov 14 04:47:47 user nova-compute[75469]:   <iothreads supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:   <os supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='firmware'/>
Nov 14 04:47:47 user nova-compute[75469]:     <loader supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>rom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pflash</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='readonly'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>yes</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='secure'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </loader>
Nov 14 04:47:47 user nova-compute[75469]:   </os>
Nov 14 04:47:47 user nova-compute[75469]:   <cpu>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-passthrough' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='hostPassthroughMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='maximum' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='maximumMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-model' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <vendor>Intel</vendor>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ss'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='vmx'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pcid'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='hypervisor'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arat'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='umip'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='md-clear'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibpb'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibrs'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='erms'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='lm'/>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='custom' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>qemu64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>qemu32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>phenom</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>n270</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>kvm64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>coreduo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>core2duo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>athlon</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Westmere</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Snowridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Penryn</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G5</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G4</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G1</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Nehalem</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Rome</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Milan</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Dhyana</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cooperlake</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Conroe</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>486</model>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:   </cpu>
Nov 14 04:47:47 user nova-compute[75469]:   <memoryBacking supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='sourceType'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>file</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>anonymous</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>memfd</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:   </memoryBacking>
Nov 14 04:47:47 user nova-compute[75469]:   <devices>
Nov 14 04:47:47 user nova-compute[75469]:     <disk supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='diskDevice'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>disk</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cdrom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>floppy</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>lun</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='bus'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ide</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>fdc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sata</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </disk>
Nov 14 04:47:47 user nova-compute[75469]:     <graphics supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sdl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vnc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>spice</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egl-headless</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </graphics>
Nov 14 04:47:47 user nova-compute[75469]:     <video supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='modelType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cirrus</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vmvga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>qxl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>none</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>bochs</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ramfb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </video>
Nov 14 04:47:47 user nova-compute[75469]:     <hostdev supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='mode'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>subsystem</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='startupPolicy'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>default</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>mandatory</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>requisite</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>optional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='subsysType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pci</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='capsType'/>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='pciBackend'/>
Nov 14 04:47:47 user nova-compute[75469]:     </hostdev>
Nov 14 04:47:47 user nova-compute[75469]:     <rng supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>random</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egd</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>builtin</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </rng>
Nov 14 04:47:47 user nova-compute[75469]:     <filesystem supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='driverType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>path</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>handle</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtiofs</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </filesystem>
Nov 14 04:47:47 user nova-compute[75469]:     <tpm supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-tis</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-crb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>passthrough</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>emulator</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </tpm>
Nov 14 04:47:47 user nova-compute[75469]:   </devices>
Nov 14 04:47:47 user nova-compute[75469]:   <features>
Nov 14 04:47:47 user nova-compute[75469]:     <gic supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     <vmcoreinfo supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <genid supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backingStoreInput supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backup supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <sev supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:   </features>
Nov 14 04:47:47 user nova-compute[75469]: </domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:  {{(pid=75469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 04:47:47 user nova-compute[75469]: <domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 04:47:47 user nova-compute[75469]:   <domain>kvm</domain>
Nov 14 04:47:47 user nova-compute[75469]:   <machine>pc-q35-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:   <arch>x86_64</arch>
Nov 14 04:47:47 user nova-compute[75469]:   <vcpu max='288'/>
Nov 14 04:47:47 user nova-compute[75469]:   <iothreads supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:   <os supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='firmware'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>efi</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:     <loader supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>rom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pflash</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='readonly'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>yes</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='secure'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>yes</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </loader>
Nov 14 04:47:47 user nova-compute[75469]:   </os>
Nov 14 04:47:47 user nova-compute[75469]:   <cpu>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-passthrough' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='hostPassthroughMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='maximum' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='maximumMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-model' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <vendor>Intel</vendor>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ss'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='vmx'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pcid'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='hypervisor'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arat'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='umip'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='md-clear'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='invtsc'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibpb'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibrs'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='rsba'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='erms'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='custom' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>qemu64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>qemu32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>phenom</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>n270</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>coreduo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>core2duo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>athlon</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Westmere</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Snowridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Penryn</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G5</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G4</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Opteron_G1</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Nehalem</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Rome</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Milan</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Dhyana</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cooperlake</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Conroe</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>486</model>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:   </cpu>
Nov 14 04:47:47 user nova-compute[75469]:   <memoryBacking supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='sourceType'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>file</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>anonymous</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>memfd</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:   </memoryBacking>
Nov 14 04:47:47 user nova-compute[75469]:   <devices>
Nov 14 04:47:47 user nova-compute[75469]:     <disk supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='diskDevice'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>disk</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cdrom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>floppy</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>lun</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='bus'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>fdc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sata</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </disk>
Nov 14 04:47:47 user nova-compute[75469]:     <graphics supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sdl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vnc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>spice</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egl-headless</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </graphics>
Nov 14 04:47:47 user nova-compute[75469]:     <video supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='modelType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cirrus</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vmvga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>qxl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>none</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>bochs</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ramfb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </video>
Nov 14 04:47:47 user nova-compute[75469]:     <hostdev supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='mode'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>subsystem</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='startupPolicy'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>default</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>mandatory</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>requisite</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>optional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='subsysType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pci</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='capsType'/>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='pciBackend'/>
Nov 14 04:47:47 user nova-compute[75469]:     </hostdev>
Nov 14 04:47:47 user nova-compute[75469]:     <rng supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>random</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egd</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>builtin</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </rng>
Nov 14 04:47:47 user nova-compute[75469]:     <filesystem supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='driverType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>path</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>handle</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtiofs</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </filesystem>
Nov 14 04:47:47 user nova-compute[75469]:     <tpm supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-tis</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-crb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>passthrough</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>emulator</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </tpm>
Nov 14 04:47:47 user nova-compute[75469]:   </devices>
Nov 14 04:47:47 user nova-compute[75469]:   <features>
Nov 14 04:47:47 user nova-compute[75469]:     <gic supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     <vmcoreinfo supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <genid supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backingStoreInput supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backup supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <sev supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:   </features>
Nov 14 04:47:47 user nova-compute[75469]: </domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:  {{(pid=75469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 04:47:47 user nova-compute[75469]: <domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 04:47:47 user nova-compute[75469]:   <domain>kvm</domain>
Nov 14 04:47:47 user nova-compute[75469]:   <machine>pc-i440fx-6.2</machine>
Nov 14 04:47:47 user nova-compute[75469]:   <arch>x86_64</arch>
Nov 14 04:47:47 user nova-compute[75469]:   <vcpu max='255'/>
Nov 14 04:47:47 user nova-compute[75469]:   <iothreads supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:   <os supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='firmware'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>efi</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:     <loader supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>rom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pflash</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='readonly'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>yes</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='secure'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </loader>
Nov 14 04:47:47 user nova-compute[75469]:   </os>
Nov 14 04:47:47 user nova-compute[75469]:   <cpu>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-passthrough' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='hostPassthroughMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='maximum' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='maximumMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-model' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <vendor>Intel</vendor>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ss'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='vmx'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pcid'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='hypervisor'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arat'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='umip'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='md-clear'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='invtsc'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibpb'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibrs'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='rsba'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='erms'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='custom' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>qemu64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>qemu32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>phenom</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>n270</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>coreduo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>core2duo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>athlon</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Westmere</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Snowridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Penryn</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G5</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G4</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Opteron_G1</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Nehalem</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Rome</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Milan</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Dhyana</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cooperlake</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Conroe</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>486</model>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:   </cpu>
Nov 14 04:47:47 user nova-compute[75469]:   <memoryBacking supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='sourceType'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>file</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>anonymous</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>memfd</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:   </memoryBacking>
Nov 14 04:47:47 user nova-compute[75469]:   <devices>
Nov 14 04:47:47 user nova-compute[75469]:     <disk supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='diskDevice'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>disk</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cdrom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>floppy</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>lun</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='bus'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ide</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>fdc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sata</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </disk>
Nov 14 04:47:47 user nova-compute[75469]:     <graphics supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sdl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vnc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>spice</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egl-headless</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </graphics>
Nov 14 04:47:47 user nova-compute[75469]:     <video supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='modelType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cirrus</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vmvga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>qxl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>none</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>bochs</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ramfb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </video>
Nov 14 04:47:47 user nova-compute[75469]:     <hostdev supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='mode'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>subsystem</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='startupPolicy'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>default</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>mandatory</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>requisite</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>optional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='subsysType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pci</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='capsType'/>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='pciBackend'/>
Nov 14 04:47:47 user nova-compute[75469]:     </hostdev>
Nov 14 04:47:47 user nova-compute[75469]:     <rng supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>random</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egd</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>builtin</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </rng>
Nov 14 04:47:47 user nova-compute[75469]:     <filesystem supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='driverType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>path</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>handle</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtiofs</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </filesystem>
Nov 14 04:47:47 user nova-compute[75469]:     <tpm supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-tis</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-crb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>passthrough</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>emulator</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </tpm>
Nov 14 04:47:47 user nova-compute[75469]:   </devices>
Nov 14 04:47:47 user nova-compute[75469]:   <features>
Nov 14 04:47:47 user nova-compute[75469]:     <gic supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     <vmcoreinfo supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <genid supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backingStoreInput supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backup supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <sev supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:   </features>
Nov 14 04:47:47 user nova-compute[75469]: </domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:  {{(pid=75469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 04:47:47 user nova-compute[75469]: <domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 04:47:47 user nova-compute[75469]:   <domain>kvm</domain>
Nov 14 04:47:47 user nova-compute[75469]:   <machine>pc-q35-jammy</machine>
Nov 14 04:47:47 user nova-compute[75469]:   <arch>x86_64</arch>
Nov 14 04:47:47 user nova-compute[75469]:   <vcpu max='288'/>
Nov 14 04:47:47 user nova-compute[75469]:   <iothreads supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:   <os supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='firmware'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>efi</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:     <loader supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>rom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pflash</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='readonly'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>yes</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='secure'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>yes</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </loader>
Nov 14 04:47:47 user nova-compute[75469]:   </os>
Nov 14 04:47:47 user nova-compute[75469]:   <cpu>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-passthrough' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='hostPassthroughMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='maximum' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='maximumMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-model' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <vendor>Intel</vendor>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ss'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='vmx'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pcid'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='hypervisor'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arat'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='umip'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='md-clear'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='invtsc'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibpb'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibrs'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='rsba'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='erms'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='custom' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>qemu64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>qemu32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>phenom</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>n270</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>coreduo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>core2duo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>athlon</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Westmere</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Snowridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Penryn</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G5</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G4</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Opteron_G1</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Nehalem</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Rome</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Milan</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Dhyana</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cooperlake</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Conroe</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>486</model>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:   </cpu>
Nov 14 04:47:47 user nova-compute[75469]:   <memoryBacking supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='sourceType'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>file</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>anonymous</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>memfd</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:   </memoryBacking>
Nov 14 04:47:47 user nova-compute[75469]:   <devices>
Nov 14 04:47:47 user nova-compute[75469]:     <disk supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='diskDevice'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>disk</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cdrom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>floppy</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>lun</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='bus'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>fdc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sata</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </disk>
Nov 14 04:47:47 user nova-compute[75469]:     <graphics supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sdl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vnc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>spice</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egl-headless</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </graphics>
Nov 14 04:47:47 user nova-compute[75469]:     <video supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='modelType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cirrus</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vmvga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>qxl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>none</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>bochs</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ramfb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </video>
Nov 14 04:47:47 user nova-compute[75469]:     <hostdev supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='mode'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>subsystem</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='startupPolicy'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>default</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>mandatory</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>requisite</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>optional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='subsysType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pci</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='capsType'/>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='pciBackend'/>
Nov 14 04:47:47 user nova-compute[75469]:     </hostdev>
Nov 14 04:47:47 user nova-compute[75469]:     <rng supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>random</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egd</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>builtin</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </rng>
Nov 14 04:47:47 user nova-compute[75469]:     <filesystem supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='driverType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>path</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>handle</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtiofs</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </filesystem>
Nov 14 04:47:47 user nova-compute[75469]:     <tpm supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-tis</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-crb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>passthrough</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>emulator</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </tpm>
Nov 14 04:47:47 user nova-compute[75469]:   </devices>
Nov 14 04:47:47 user nova-compute[75469]:   <features>
Nov 14 04:47:47 user nova-compute[75469]:     <gic supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     <vmcoreinfo supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <genid supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backingStoreInput supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backup supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <sev supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:   </features>
Nov 14 04:47:47 user nova-compute[75469]: </domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:  {{(pid=75469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 04:47:47 user nova-compute[75469]: <domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 04:47:47 user nova-compute[75469]:   <domain>kvm</domain>
Nov 14 04:47:47 user nova-compute[75469]:   <machine>pc-i440fx-jammy</machine>
Nov 14 04:47:47 user nova-compute[75469]:   <arch>x86_64</arch>
Nov 14 04:47:47 user nova-compute[75469]:   <vcpu max='255'/>
Nov 14 04:47:47 user nova-compute[75469]:   <iothreads supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:   <os supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='firmware'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>efi</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:     <loader supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>rom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pflash</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='readonly'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>yes</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='secure'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>no</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </loader>
Nov 14 04:47:47 user nova-compute[75469]:   </os>
Nov 14 04:47:47 user nova-compute[75469]:   <cpu>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-passthrough' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='hostPassthroughMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='maximum' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='maximumMigratable'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>on</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>off</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='host-model' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <vendor>Intel</vendor>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ss'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='vmx'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pcid'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='hypervisor'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arat'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='umip'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='md-clear'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='invtsc'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibpb'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='ibrs'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-stibp'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='rsba'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='erms'/>
Nov 14 04:47:47 user nova-compute[75469]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:     <mode name='custom' supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>qemu64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>qemu32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>phenom</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>pentium</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>n270</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm64</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>kvm32</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>coreduo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>core2duo</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>athlon</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Westmere</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Snowridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Skylake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>SandyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Penryn</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G5</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G4</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G3</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Opteron_G2</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Opteron_G1</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Nehalem</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>IvyBridge</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Icelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Haswell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Rome</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-Milan</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>EPYC</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Dhyana</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cooperlake</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>Conroe</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='no'>Broadwell</model>
Nov 14 04:47:47 user nova-compute[75469]:       <model usable='yes'>486</model>
Nov 14 04:47:47 user nova-compute[75469]:     </mode>
Nov 14 04:47:47 user nova-compute[75469]:   </cpu>
Nov 14 04:47:47 user nova-compute[75469]:   <memoryBacking supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:     <enum name='sourceType'>
Nov 14 04:47:47 user nova-compute[75469]:       <value>file</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>anonymous</value>
Nov 14 04:47:47 user nova-compute[75469]:       <value>memfd</value>
Nov 14 04:47:47 user nova-compute[75469]:     </enum>
Nov 14 04:47:47 user nova-compute[75469]:   </memoryBacking>
Nov 14 04:47:47 user nova-compute[75469]:   <devices>
Nov 14 04:47:47 user nova-compute[75469]:     <disk supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='diskDevice'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>disk</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cdrom</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>floppy</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>lun</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='bus'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ide</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>fdc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sata</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </disk>
Nov 14 04:47:47 user nova-compute[75469]:     <graphics supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='type'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>sdl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vnc</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>spice</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egl-headless</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </graphics>
Nov 14 04:47:47 user nova-compute[75469]:     <video supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='modelType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>cirrus</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>vmvga</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>qxl</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>none</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>bochs</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>ramfb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </video>
Nov 14 04:47:47 user nova-compute[75469]:     <hostdev supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='mode'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>subsystem</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='startupPolicy'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>default</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>mandatory</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>requisite</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>optional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='subsysType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>usb</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>pci</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>scsi</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='capsType'/>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='pciBackend'/>
Nov 14 04:47:47 user nova-compute[75469]:     </hostdev>
Nov 14 04:47:47 user nova-compute[75469]:     <rng supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtio-non-transitional</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>random</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>egd</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>builtin</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </rng>
Nov 14 04:47:47 user nova-compute[75469]:     <filesystem supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='driverType'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>path</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>handle</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>virtiofs</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </filesystem>
Nov 14 04:47:47 user nova-compute[75469]:     <tpm supported='yes'>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='model'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-tis</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>tpm-crb</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:       <enum name='backendModel'>
Nov 14 04:47:47 user nova-compute[75469]:         <value>passthrough</value>
Nov 14 04:47:47 user nova-compute[75469]:         <value>emulator</value>
Nov 14 04:47:47 user nova-compute[75469]:       </enum>
Nov 14 04:47:47 user nova-compute[75469]:     </tpm>
Nov 14 04:47:47 user nova-compute[75469]:   </devices>
Nov 14 04:47:47 user nova-compute[75469]:   <features>
Nov 14 04:47:47 user nova-compute[75469]:     <gic supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:     <vmcoreinfo supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <genid supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backingStoreInput supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <backup supported='yes'/>
Nov 14 04:47:47 user nova-compute[75469]:     <sev supported='no'/>
Nov 14 04:47:47 user nova-compute[75469]:   </features>
Nov 14 04:47:47 user nova-compute[75469]: </domainCapabilities>
Nov 14 04:47:47 user nova-compute[75469]:  {{(pid=75469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Checking secure boot support for host arch (x86_64) {{(pid=75469) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 04:47:47 user nova-compute[75469]: INFO nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Secure Boot support detected
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] cpu compare xml: <cpu match="exact">
Nov 14 04:47:47 user nova-compute[75469]:   <model>Nehalem</model>
Nov 14 04:47:47 user nova-compute[75469]: </cpu>
Nov 14 04:47:47 user nova-compute[75469]:  {{(pid=75469) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 04:47:47 user nova-compute[75469]: INFO nova.virt.node [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Generated node identity 96d8ab03-209c-478b-97a4-3b20ae4d0ee4
Nov 14 04:47:47 user nova-compute[75469]: INFO nova.virt.node [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Wrote node identity 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 to /opt/stack/data/nova/compute_id
Nov 14 04:47:47 user nova-compute[75469]: WARNING nova.compute.manager [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Compute nodes ['96d8ab03-209c-478b-97a4-3b20ae4d0ee4'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 04:47:47 user nova-compute[75469]: INFO nova.compute.manager [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 04:47:47 user nova-compute[75469]: WARNING nova.compute.manager [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 04:47:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:47:47 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:47:47 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:47:47 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Hypervisor/Node resource view: name=user free_ram=10956MB free_disk=26.015296936035156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:47:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:47:47 user nova-compute[75469]: WARNING nova.compute.resource_tracker [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] No compute node record for user:96d8ab03-209c-478b-97a4-3b20ae4d0ee4: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 could not be found.
Nov 14 04:47:48 user nova-compute[75469]: INFO nova.compute.resource_tracker [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Compute node record created for user:user with uuid: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:47:48 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] [req-cf4987b5-0f3c-4455-bcc1-ac6e6c8ef3db] Created resource provider record via placement API for resource provider with UUID 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 and name user.
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75469) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 04:47:48 user nova-compute[75469]: INFO nova.virt.libvirt.host [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] kernel doesn't support AMD SEV
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Libvirt baseline CPU <cpu>
Nov 14 04:47:48 user nova-compute[75469]:   <arch>x86_64</arch>
Nov 14 04:47:48 user nova-compute[75469]:   <model>Nehalem</model>
Nov 14 04:47:48 user nova-compute[75469]:   <vendor>Intel</vendor>
Nov 14 04:47:48 user nova-compute[75469]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 04:47:48 user nova-compute[75469]: </cpu>
Nov 14 04:47:48 user nova-compute[75469]:  {{(pid=75469) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Updated inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Updating resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 generation from 0 to 1 during operation: update_inventory {{(pid=75469) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Updating resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 generation from 1 to 2 during operation: update_traits {{(pid=75469) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.770s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.service [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Creating RPC server for service compute {{(pid=75469) start /opt/stack/nova/nova/service.py:182}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.service [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] Join ServiceGroup membership for this service compute {{(pid=75469) start /opt/stack/nova/nova/service.py:199}}
Nov 14 04:47:48 user nova-compute[75469]: DEBUG nova.servicegroup.drivers.db [None req-48abdfac-db88-4c41-82c5-6c098618a6c3 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75469) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:48:39 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:48:39 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:48:39 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=10364MB free_disk=25.919063568115234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:48:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:48:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:48:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:48:40 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:48:40 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:48:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:48:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:48:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:49:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:49:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:49:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:49:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:49:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:49:40 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:49:40 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:49:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=10335MB free_disk=25.98330307006836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:49:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.102s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:49:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:50:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:50:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:50:40 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:50:40 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:50:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=10358MB free_disk=25.735916137695312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:50:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:50:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:50:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:50:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:50:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:50:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 04:50:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:50:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:50:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:50:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:50:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:51:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:51:40 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:51:40 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:51:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9641MB free_disk=25.764690399169922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:51:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:51:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:51:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:51:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 04:51:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:51:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:51:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:51:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:51:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:51:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:51:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:51:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:51:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:47 user nova-compute[75469]: DEBUG nova.compute.manager [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:51:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:51:47 user nova-compute[75469]: INFO nova.compute.claims [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Claim successful on node user
Nov 14 04:51:47 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:51:47 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:51:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:51:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:51:48 user nova-compute[75469]: DEBUG nova.network.neutron [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:51:48 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:51:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:51:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:51:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:51:48 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Creating image(s)
Nov 14 04:51:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "/opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "/opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "/opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2.part --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG nova.policy [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a23a8feda3e4d7581666ca3ee20aa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e392b9dd841a4eacab6c4aff4f60e536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "eb7dea82-3146-4248-bbd7-73d4d8431900" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2.part --force-share --output=json" returned: 0 in 0.224s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG nova.virt.images [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] 7b828d08-5de0-47b5-a30d-5095d166987a was qcow2, converting to raw {{(pid=75469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2.part /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2.converted {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG nova.compute.manager [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:51:49 user nova-compute[75469]: INFO nova.compute.claims [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Claim successful on node user
Nov 14 04:51:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2.part /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2.converted" returned: 0 in 0.281s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2.converted --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.454s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:49 user nova-compute[75469]: INFO oslo.privsep.daemon [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfi465ci1/privsep.sock']
Nov 14 04:51:49 user sudo[84712]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfi465ci1/privsep.sock
Nov 14 04:51:49 user sudo[84712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 04:51:50 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:51:50 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:51:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:51:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:51:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:51:50 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:51:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:51:50 user nova-compute[75469]: DEBUG nova.policy [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf6681ae7c2d427ba0c5fe6cd0079b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dffcd3e1524676b66fbfc2833afe6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:51:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:51:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:51:50 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Creating image(s)
Nov 14 04:51:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "/opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "/opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:51 user sudo[84712]: pam_unix(sudo:session): session closed for user root
Nov 14 04:51:51 user nova-compute[75469]: INFO oslo.privsep.daemon [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Spawned new privsep daemon via rootwrap
Nov 14 04:51:51 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 04:51:51 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 04:51:51 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 04:51:51 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84744
Nov 14 04:51:51 user nova-compute[75469]: WARNING oslo_privsep.priv_context [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] privsep daemon already running
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG nova.network.neutron [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Successfully created port: f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.166s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.211s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.196s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk 1073741824" returned: 0 in 0.038s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.186s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.196s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk 1073741824" returned: 0 in 0.038s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:51:52 user nova-compute[75469]: INFO nova.compute.claims [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Claim successful on node user
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Cannot resize image /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Ensure instance console log exists: /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.network.neutron [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Successfully created port: 46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Cannot resize image /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Ensure instance console log exists: /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.network.neutron [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:51:52 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.network.neutron [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Successfully updated port: f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "refresh_cache-eb7dea82-3146-4248-bbd7-73d4d8431900" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquired lock "refresh_cache-eb7dea82-3146-4248-bbd7-73d4d8431900" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.network.neutron [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:51:52 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Creating image(s)
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "/opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "/opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "/opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.policy [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3142f0a24ee841878d06e14817fa1f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e85721ebed4cccaecde59d1944cd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG nova.network.neutron [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.195s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-0464050b-36d2-4ecc-bb1a-8480299b61b3 req-3818af00-41ed-4808-91b1-57ee963fe64e service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Received event network-changed-f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-0464050b-36d2-4ecc-bb1a-8480299b61b3 req-3818af00-41ed-4808-91b1-57ee963fe64e service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Refreshing instance network info cache due to event network-changed-f1faa88f-6b82-4534-92f5-60e012308547. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0464050b-36d2-4ecc-bb1a-8480299b61b3 req-3818af00-41ed-4808-91b1-57ee963fe64e service nova] Acquiring lock "refresh_cache-eb7dea82-3146-4248-bbd7-73d4d8431900" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk 1073741824" returned: 0 in 0.042s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.190s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:51:53 user nova-compute[75469]: INFO nova.compute.claims [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Claim successful on node user
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Cannot resize image /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Ensure instance console log exists: /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.network.neutron [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Updating instance_info_cache with network_info: [{"id": "f1faa88f-6b82-4534-92f5-60e012308547", "address": "fa:16:3e:00:76:a8", "network": {"id": "bf0840e2-e4e0-4fe6-8396-777bcb4a8bba", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677352761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67dffcd3e1524676b66fbfc2833afe6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1faa88f-6b", "ovs_interfaceid": "f1faa88f-6b82-4534-92f5-60e012308547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Releasing lock "refresh_cache-eb7dea82-3146-4248-bbd7-73d4d8431900" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Instance network_info: |[{"id": "f1faa88f-6b82-4534-92f5-60e012308547", "address": "fa:16:3e:00:76:a8", "network": {"id": "bf0840e2-e4e0-4fe6-8396-777bcb4a8bba", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677352761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67dffcd3e1524676b66fbfc2833afe6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1faa88f-6b", "ovs_interfaceid": "f1faa88f-6b82-4534-92f5-60e012308547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0464050b-36d2-4ecc-bb1a-8480299b61b3 req-3818af00-41ed-4808-91b1-57ee963fe64e service nova] Acquired lock "refresh_cache-eb7dea82-3146-4248-bbd7-73d4d8431900" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.network.neutron [req-0464050b-36d2-4ecc-bb1a-8480299b61b3 req-3818af00-41ed-4808-91b1-57ee963fe64e service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Refreshing network info cache for port f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Start _get_guest_xml network_info=[{"id": "f1faa88f-6b82-4534-92f5-60e012308547", "address": "fa:16:3e:00:76:a8", "network": {"id": "bf0840e2-e4e0-4fe6-8396-777bcb4a8bba", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677352761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67dffcd3e1524676b66fbfc2833afe6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1faa88f-6b", "ovs_interfaceid": "f1faa88f-6b82-4534-92f5-60e012308547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:51:53 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:51:53 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1951733129',display_name='tempest-DeleteServersTestJSON-server-1951733129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1951733129',id=2,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67dffcd3e1524676b66fbfc2833afe6c',ramdisk_id='',reservation_id='r-ojo8o53k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-914079182',owner_user_name='tempest-DeleteServersTestJSON-914079182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:51:50Z,user_data=None,user_id='cf6681ae7c2d427ba0c5fe6cd0079b92',uuid=eb7dea82-3146-4248-bbd7-73d4d8431900,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1faa88f-6b82-4534-92f5-60e012308547", "address": "fa:16:3e:00:76:a8", "network": {"id": "bf0840e2-e4e0-4fe6-8396-777bcb4a8bba", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677352761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67dffcd3e1524676b66fbfc2833afe6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1faa88f-6b", "ovs_interfaceid": "f1faa88f-6b82-4534-92f5-60e012308547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Converting VIF {"id": "f1faa88f-6b82-4534-92f5-60e012308547", "address": "fa:16:3e:00:76:a8", "network": {"id": "bf0840e2-e4e0-4fe6-8396-777bcb4a8bba", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677352761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67dffcd3e1524676b66fbfc2833afe6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1faa88f-6b", "ovs_interfaceid": "f1faa88f-6b82-4534-92f5-60e012308547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=f1faa88f-6b82-4534-92f5-60e012308547,network=Network(bf0840e2-e4e0-4fe6-8396-777bcb4a8bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1faa88f-6b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.objects.instance [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lazy-loading 'pci_devices' on Instance uuid eb7dea82-3146-4248-bbd7-73d4d8431900 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:51:53 user nova-compute[75469]:   <uuid>eb7dea82-3146-4248-bbd7-73d4d8431900</uuid>
Nov 14 04:51:53 user nova-compute[75469]:   <name>instance-00000002</name>
Nov 14 04:51:53 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:51:53 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:51:53 user nova-compute[75469]:   <metadata>
Nov 14 04:51:53 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:51:53 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:51:53 user nova-compute[75469]:       <nova:name>tempest-DeleteServersTestJSON-server-1951733129</nova:name>
Nov 14 04:51:53 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:51:53</nova:creationTime>
Nov 14 04:51:53 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:51:53 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:51:53 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:51:53 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:51:53 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:51:53 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:51:53 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:51:53 user nova-compute[75469]:       <nova:owner>
Nov 14 04:51:53 user nova-compute[75469]:         <nova:user uuid="cf6681ae7c2d427ba0c5fe6cd0079b92">tempest-DeleteServersTestJSON-914079182-project-member</nova:user>
Nov 14 04:51:53 user nova-compute[75469]:         <nova:project uuid="67dffcd3e1524676b66fbfc2833afe6c">tempest-DeleteServersTestJSON-914079182</nova:project>
Nov 14 04:51:53 user nova-compute[75469]:       </nova:owner>
Nov 14 04:51:53 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:51:53 user nova-compute[75469]:       <nova:ports>
Nov 14 04:51:53 user nova-compute[75469]:         <nova:port uuid="f1faa88f-6b82-4534-92f5-60e012308547">
Nov 14 04:51:53 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 04:51:53 user nova-compute[75469]:         </nova:port>
Nov 14 04:51:53 user nova-compute[75469]:       </nova:ports>
Nov 14 04:51:53 user nova-compute[75469]:     </nova:instance>
Nov 14 04:51:53 user nova-compute[75469]:   </metadata>
Nov 14 04:51:53 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:51:53 user nova-compute[75469]:     <system>
Nov 14 04:51:53 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:51:53 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:51:53 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:51:53 user nova-compute[75469]:       <entry name="serial">eb7dea82-3146-4248-bbd7-73d4d8431900</entry>
Nov 14 04:51:53 user nova-compute[75469]:       <entry name="uuid">eb7dea82-3146-4248-bbd7-73d4d8431900</entry>
Nov 14 04:51:53 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:51:53 user nova-compute[75469]:     </system>
Nov 14 04:51:53 user nova-compute[75469]:   </sysinfo>
Nov 14 04:51:53 user nova-compute[75469]:   <os>
Nov 14 04:51:53 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:51:53 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:51:53 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:51:53 user nova-compute[75469]:   </os>
Nov 14 04:51:53 user nova-compute[75469]:   <features>
Nov 14 04:51:53 user nova-compute[75469]:     <acpi/>
Nov 14 04:51:53 user nova-compute[75469]:     <apic/>
Nov 14 04:51:53 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:51:53 user nova-compute[75469]:   </features>
Nov 14 04:51:53 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:51:53 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:51:53 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:51:53 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:51:53 user nova-compute[75469]:   </clock>
Nov 14 04:51:53 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:51:53 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:51:53 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:51:53 user nova-compute[75469]:   </cpu>
Nov 14 04:51:53 user nova-compute[75469]:   <devices>
Nov 14 04:51:53 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:51:53 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:51:53 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk"/>
Nov 14 04:51:53 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:51:53 user nova-compute[75469]:     </disk>
Nov 14 04:51:53 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:51:53 user nova-compute[75469]:       <mac address="fa:16:3e:00:76:a8"/>
Nov 14 04:51:53 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:51:53 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:51:53 user nova-compute[75469]:       <target dev="tapf1faa88f-6b"/>
Nov 14 04:51:53 user nova-compute[75469]:     </interface>
Nov 14 04:51:53 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:51:53 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/console.log" append="off"/>
Nov 14 04:51:53 user nova-compute[75469]:     </serial>
Nov 14 04:51:53 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:51:53 user nova-compute[75469]:     <video>
Nov 14 04:51:53 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:51:53 user nova-compute[75469]:     </video>
Nov 14 04:51:53 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:51:53 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:51:53 user nova-compute[75469]:     </rng>
Nov 14 04:51:53 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:51:53 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:51:53 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:51:53 user nova-compute[75469]:     </memballoon>
Nov 14 04:51:53 user nova-compute[75469]:   </devices>
Nov 14 04:51:53 user nova-compute[75469]: </domain>
Nov 14 04:51:53 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1951733129',display_name='tempest-DeleteServersTestJSON-server-1951733129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1951733129',id=2,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67dffcd3e1524676b66fbfc2833afe6c',ramdisk_id='',reservation_id='r-ojo8o53k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-914079182',owner_user_name='tempest-DeleteServersTestJSON-914079182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:51:50Z,user_data=None,user_id='cf6681ae7c2d427ba0c5fe6cd0079b92',uuid=eb7dea82-3146-4248-bbd7-73d4d8431900,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1faa88f-6b82-4534-92f5-60e012308547", "address": "fa:16:3e:00:76:a8", "network": {"id": "bf0840e2-e4e0-4fe6-8396-777bcb4a8bba", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677352761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67dffcd3e1524676b66fbfc2833afe6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1faa88f-6b", "ovs_interfaceid": "f1faa88f-6b82-4534-92f5-60e012308547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Converting VIF {"id": "f1faa88f-6b82-4534-92f5-60e012308547", "address": "fa:16:3e:00:76:a8", "network": {"id": "bf0840e2-e4e0-4fe6-8396-777bcb4a8bba", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677352761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67dffcd3e1524676b66fbfc2833afe6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1faa88f-6b", "ovs_interfaceid": "f1faa88f-6b82-4534-92f5-60e012308547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=f1faa88f-6b82-4534-92f5-60e012308547,network=Network(bf0840e2-e4e0-4fe6-8396-777bcb4a8bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1faa88f-6b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG os_vif [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=f1faa88f-6b82-4534-92f5-60e012308547,network=Network(bf0840e2-e4e0-4fe6-8396-777bcb4a8bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1faa88f-6b') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Created schema index Interface.name {{(pid=75469) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Created schema index Port.name {{(pid=75469) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Created schema index Bridge.name {{(pid=75469) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [POLLOUT] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6e1e184-5936-5718-b759-fcccd03ba12c', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:51:53 user nova-compute[75469]: INFO oslo.privsep.daemon [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpi1q9hj4p/privsep.sock']
Nov 14 04:51:53 user sudo[84810]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpi1q9hj4p/privsep.sock
Nov 14 04:51:53 user sudo[84810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 04:51:54 user nova-compute[75469]: DEBUG nova.compute.manager [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:51:54 user nova-compute[75469]: DEBUG nova.network.neutron [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:51:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:51:54 user nova-compute[75469]: DEBUG nova.compute.manager [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:51:54 user nova-compute[75469]: DEBUG nova.policy [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73c089065dec4fbdaf39807c43265ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a921fed4277644dd9b75295d99c4af6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:51:54 user nova-compute[75469]: DEBUG nova.compute.manager [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:51:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:51:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Creating image(s)
Nov 14 04:51:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "/opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "/opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:54 user nova-compute[75469]: DEBUG nova.network.neutron [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Successfully created port: 5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:51:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.157s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk 1073741824" returned: 0 in 0.045s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG nova.network.neutron [req-0464050b-36d2-4ecc-bb1a-8480299b61b3 req-3818af00-41ed-4808-91b1-57ee963fe64e service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Updated VIF entry in instance network info cache for port f1faa88f-6b82-4534-92f5-60e012308547. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG nova.network.neutron [req-0464050b-36d2-4ecc-bb1a-8480299b61b3 req-3818af00-41ed-4808-91b1-57ee963fe64e service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Updating instance_info_cache with network_info: [{"id": "f1faa88f-6b82-4534-92f5-60e012308547", "address": "fa:16:3e:00:76:a8", "network": {"id": "bf0840e2-e4e0-4fe6-8396-777bcb4a8bba", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677352761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67dffcd3e1524676b66fbfc2833afe6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1faa88f-6b", "ovs_interfaceid": "f1faa88f-6b82-4534-92f5-60e012308547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0464050b-36d2-4ecc-bb1a-8480299b61b3 req-3818af00-41ed-4808-91b1-57ee963fe64e service nova] Releasing lock "refresh_cache-eb7dea82-3146-4248-bbd7-73d4d8431900" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:55 user sudo[84810]: pam_unix(sudo:session): session closed for user root
Nov 14 04:51:55 user nova-compute[75469]: INFO oslo.privsep.daemon [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Spawned new privsep daemon via rootwrap
Nov 14 04:51:55 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 04:51:55 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 04:51:55 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 04:51:55 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84833
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Cannot resize image /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Ensure instance console log exists: /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG nova.network.neutron [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Successfully updated port: 46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquired lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG nova.network.neutron [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG nova.network.neutron [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-04864531-6314-45d7-aad6-195bdcdd9695 req-e7659d99-afad-4c68-9629-fcb16825d584 service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Received event network-changed-46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-04864531-6314-45d7-aad6-195bdcdd9695 req-e7659d99-afad-4c68-9629-fcb16825d584 service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Refreshing instance network info cache due to event network-changed-46427af9-a17a-49dd-9905-509577765b07. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:51:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-04864531-6314-45d7-aad6-195bdcdd9695 req-e7659d99-afad-4c68-9629-fcb16825d584 service nova] Acquiring lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1faa88f-6b, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1faa88f-6b, col_values=(('qos', UUID('77e1c576-9502-4379-9e85-63361ca38f05')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1faa88f-6b, col_values=(('external_ids', {'iface-id': 'f1faa88f-6b82-4534-92f5-60e012308547', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:76:a8', 'vm-uuid': 'eb7dea82-3146-4248-bbd7-73d4d8431900'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:56 user nova-compute[75469]: INFO os_vif [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=f1faa88f-6b82-4534-92f5-60e012308547,network=Network(bf0840e2-e4e0-4fe6-8396-777bcb4a8bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1faa88f-6b')
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] No VIF found with MAC fa:16:3e:00:76:a8, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.network.neutron [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Successfully created port: 45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.network.neutron [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Successfully updated port: 5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquired lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.network.neutron [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.compute.manager [req-7effa4e6-2bfe-49cc-b838-0e90e7b7d4cf req-5bc6599b-4803-417a-8a4d-46c1374168b5 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-changed-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.compute.manager [req-7effa4e6-2bfe-49cc-b838-0e90e7b7d4cf req-5bc6599b-4803-417a-8a4d-46c1374168b5 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Refreshing instance network info cache due to event network-changed-5d0308df-4ec4-495c-b85e-73900b018564. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7effa4e6-2bfe-49cc-b838-0e90e7b7d4cf req-5bc6599b-4803-417a-8a4d-46c1374168b5 service nova] Acquiring lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.network.neutron [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:51:56 user nova-compute[75469]: INFO nova.compute.claims [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Claim successful on node user
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.network.neutron [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updating instance_info_cache with network_info: [{"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Releasing lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.compute.manager [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Instance network_info: |[{"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-04864531-6314-45d7-aad6-195bdcdd9695 req-e7659d99-afad-4c68-9629-fcb16825d584 service nova] Acquired lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.network.neutron [req-04864531-6314-45d7-aad6-195bdcdd9695 req-e7659d99-afad-4c68-9629-fcb16825d584 service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Refreshing network info cache for port 46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Start _get_guest_xml network_info=[{"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:51:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:51:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-548546716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-548546716',id=1,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-llt9y47v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:51:48Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=80741f98-11b9-4a80-a51b-39d5ce4e44f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=46427af9-a17a-49dd-9905-509577765b07,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46427af9-a1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.objects.instance [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'pci_devices' on Instance uuid 80741f98-11b9-4a80-a51b-39d5ce4e44f5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:51:56 user nova-compute[75469]:   <uuid>80741f98-11b9-4a80-a51b-39d5ce4e44f5</uuid>
Nov 14 04:51:56 user nova-compute[75469]:   <name>instance-00000001</name>
Nov 14 04:51:56 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:51:56 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:51:56 user nova-compute[75469]:   <metadata>
Nov 14 04:51:56 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:51:56 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:51:56 user nova-compute[75469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-548546716</nova:name>
Nov 14 04:51:56 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:51:56</nova:creationTime>
Nov 14 04:51:56 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:51:56 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:51:56 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:51:56 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:51:56 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:51:56 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:51:56 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:51:56 user nova-compute[75469]:       <nova:owner>
Nov 14 04:51:56 user nova-compute[75469]:         <nova:user uuid="3a23a8feda3e4d7581666ca3ee20aa5f">tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member</nova:user>
Nov 14 04:51:56 user nova-compute[75469]:         <nova:project uuid="e392b9dd841a4eacab6c4aff4f60e536">tempest-ServerBootFromVolumeStableRescueTest-1634984639</nova:project>
Nov 14 04:51:56 user nova-compute[75469]:       </nova:owner>
Nov 14 04:51:56 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:51:56 user nova-compute[75469]:       <nova:ports>
Nov 14 04:51:56 user nova-compute[75469]:         <nova:port uuid="46427af9-a17a-49dd-9905-509577765b07">
Nov 14 04:51:56 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 04:51:56 user nova-compute[75469]:         </nova:port>
Nov 14 04:51:56 user nova-compute[75469]:       </nova:ports>
Nov 14 04:51:56 user nova-compute[75469]:     </nova:instance>
Nov 14 04:51:56 user nova-compute[75469]:   </metadata>
Nov 14 04:51:56 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:51:56 user nova-compute[75469]:     <system>
Nov 14 04:51:56 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:51:56 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:51:56 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:51:56 user nova-compute[75469]:       <entry name="serial">80741f98-11b9-4a80-a51b-39d5ce4e44f5</entry>
Nov 14 04:51:56 user nova-compute[75469]:       <entry name="uuid">80741f98-11b9-4a80-a51b-39d5ce4e44f5</entry>
Nov 14 04:51:56 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:51:56 user nova-compute[75469]:     </system>
Nov 14 04:51:56 user nova-compute[75469]:   </sysinfo>
Nov 14 04:51:56 user nova-compute[75469]:   <os>
Nov 14 04:51:56 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:51:56 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:51:56 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:51:56 user nova-compute[75469]:   </os>
Nov 14 04:51:56 user nova-compute[75469]:   <features>
Nov 14 04:51:56 user nova-compute[75469]:     <acpi/>
Nov 14 04:51:56 user nova-compute[75469]:     <apic/>
Nov 14 04:51:56 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:51:56 user nova-compute[75469]:   </features>
Nov 14 04:51:56 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:51:56 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:51:56 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:51:56 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:51:56 user nova-compute[75469]:   </clock>
Nov 14 04:51:56 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:51:56 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:51:56 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:51:56 user nova-compute[75469]:   </cpu>
Nov 14 04:51:56 user nova-compute[75469]:   <devices>
Nov 14 04:51:56 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:51:56 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:51:56 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk"/>
Nov 14 04:51:56 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:51:56 user nova-compute[75469]:     </disk>
Nov 14 04:51:56 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:51:56 user nova-compute[75469]:       <mac address="fa:16:3e:23:9a:cd"/>
Nov 14 04:51:56 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:51:56 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:51:56 user nova-compute[75469]:       <target dev="tap46427af9-a1"/>
Nov 14 04:51:56 user nova-compute[75469]:     </interface>
Nov 14 04:51:56 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:51:56 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/console.log" append="off"/>
Nov 14 04:51:56 user nova-compute[75469]:     </serial>
Nov 14 04:51:56 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:51:56 user nova-compute[75469]:     <video>
Nov 14 04:51:56 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:51:56 user nova-compute[75469]:     </video>
Nov 14 04:51:56 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:51:56 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:51:56 user nova-compute[75469]:     </rng>
Nov 14 04:51:56 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:51:56 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:51:56 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:51:56 user nova-compute[75469]:     </memballoon>
Nov 14 04:51:56 user nova-compute[75469]:   </devices>
Nov 14 04:51:56 user nova-compute[75469]: </domain>
Nov 14 04:51:56 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-548546716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-548546716',id=1,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-llt9y47v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:51:48Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=80741f98-11b9-4a80-a51b-39d5ce4e44f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=46427af9-a17a-49dd-9905-509577765b07,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46427af9-a1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG os_vif [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=46427af9-a17a-49dd-9905-509577765b07,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46427af9-a1') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6548d8c4-15e9-55ee-8d44-7b1542719c1c', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46427af9-a1, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46427af9-a1, col_values=(('qos', UUID('00c64214-cad3-4549-baf1-1bbfaed6e266')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46427af9-a1, col_values=(('external_ids', {'iface-id': '46427af9-a17a-49dd-9905-509577765b07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:9a:cd', 'vm-uuid': '80741f98-11b9-4a80-a51b-39d5ce4e44f5'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:56 user nova-compute[75469]: INFO os_vif [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=46427af9-a17a-49dd-9905-509577765b07,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46427af9-a1')
Nov 14 04:51:56 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No VIF found with MAC fa:16:3e:23:9a:cd, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.network.neutron [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updating instance_info_cache with network_info: [{"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Releasing lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance network_info: |[{"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7effa4e6-2bfe-49cc-b838-0e90e7b7d4cf req-5bc6599b-4803-417a-8a4d-46c1374168b5 service nova] Acquired lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.network.neutron [req-7effa4e6-2bfe-49cc-b838-0e90e7b7d4cf req-5bc6599b-4803-417a-8a4d-46c1374168b5 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Refreshing network info cache for port 5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Start _get_guest_xml network_info=[{"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:51:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:51:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:51:57 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1216043162',display_name='tempest-AttachVolumeTestJSON-server-1216043162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1216043162',id=3,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmvdCBIfh48Eeknk9EcyhY/EUByia8dNJsdA49UBgYl79YeoAE1ZBCnXslVyMxP+0apbX7EEDT0C15puJDnVXndeeRGIR/eT6s8JeH6vqhOdqMbAiRlzvoMhvGWyeiHSA==',key_name='tempest-keypair-539876909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-s5b510vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=68c68428-4d79-4dd7-94a1-9c05e5230a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.objects.instance [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'pci_devices' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:51:57 user nova-compute[75469]:   <uuid>68c68428-4d79-4dd7-94a1-9c05e5230a8a</uuid>
Nov 14 04:51:57 user nova-compute[75469]:   <name>instance-00000003</name>
Nov 14 04:51:57 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:51:57 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:51:57 user nova-compute[75469]:   <metadata>
Nov 14 04:51:57 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:51:57 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:51:57 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeTestJSON-server-1216043162</nova:name>
Nov 14 04:51:57 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:51:57</nova:creationTime>
Nov 14 04:51:57 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:51:57 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:51:57 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:51:57 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:51:57 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:51:57 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:51:57 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:51:57 user nova-compute[75469]:       <nova:owner>
Nov 14 04:51:57 user nova-compute[75469]:         <nova:user uuid="3142f0a24ee841878d06e14817fa1f86">tempest-AttachVolumeTestJSON-2079958443-project-member</nova:user>
Nov 14 04:51:57 user nova-compute[75469]:         <nova:project uuid="f7e85721ebed4cccaecde59d1944cd64">tempest-AttachVolumeTestJSON-2079958443</nova:project>
Nov 14 04:51:57 user nova-compute[75469]:       </nova:owner>
Nov 14 04:51:57 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:51:57 user nova-compute[75469]:       <nova:ports>
Nov 14 04:51:57 user nova-compute[75469]:         <nova:port uuid="5d0308df-4ec4-495c-b85e-73900b018564">
Nov 14 04:51:57 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 04:51:57 user nova-compute[75469]:         </nova:port>
Nov 14 04:51:57 user nova-compute[75469]:       </nova:ports>
Nov 14 04:51:57 user nova-compute[75469]:     </nova:instance>
Nov 14 04:51:57 user nova-compute[75469]:   </metadata>
Nov 14 04:51:57 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:51:57 user nova-compute[75469]:     <system>
Nov 14 04:51:57 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:51:57 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:51:57 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:51:57 user nova-compute[75469]:       <entry name="serial">68c68428-4d79-4dd7-94a1-9c05e5230a8a</entry>
Nov 14 04:51:57 user nova-compute[75469]:       <entry name="uuid">68c68428-4d79-4dd7-94a1-9c05e5230a8a</entry>
Nov 14 04:51:57 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:51:57 user nova-compute[75469]:     </system>
Nov 14 04:51:57 user nova-compute[75469]:   </sysinfo>
Nov 14 04:51:57 user nova-compute[75469]:   <os>
Nov 14 04:51:57 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:51:57 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:51:57 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:51:57 user nova-compute[75469]:   </os>
Nov 14 04:51:57 user nova-compute[75469]:   <features>
Nov 14 04:51:57 user nova-compute[75469]:     <acpi/>
Nov 14 04:51:57 user nova-compute[75469]:     <apic/>
Nov 14 04:51:57 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:51:57 user nova-compute[75469]:   </features>
Nov 14 04:51:57 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:51:57 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:51:57 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:51:57 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:51:57 user nova-compute[75469]:   </clock>
Nov 14 04:51:57 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:51:57 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:51:57 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:51:57 user nova-compute[75469]:   </cpu>
Nov 14 04:51:57 user nova-compute[75469]:   <devices>
Nov 14 04:51:57 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:51:57 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:51:57 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk"/>
Nov 14 04:51:57 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:51:57 user nova-compute[75469]:     </disk>
Nov 14 04:51:57 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:51:57 user nova-compute[75469]:       <mac address="fa:16:3e:de:a7:a6"/>
Nov 14 04:51:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:51:57 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:51:57 user nova-compute[75469]:       <target dev="tap5d0308df-4e"/>
Nov 14 04:51:57 user nova-compute[75469]:     </interface>
Nov 14 04:51:57 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:51:57 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/console.log" append="off"/>
Nov 14 04:51:57 user nova-compute[75469]:     </serial>
Nov 14 04:51:57 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:51:57 user nova-compute[75469]:     <video>
Nov 14 04:51:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:51:57 user nova-compute[75469]:     </video>
Nov 14 04:51:57 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:51:57 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:51:57 user nova-compute[75469]:     </rng>
Nov 14 04:51:57 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:51:57 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:51:57 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:51:57 user nova-compute[75469]:     </memballoon>
Nov 14 04:51:57 user nova-compute[75469]:   </devices>
Nov 14 04:51:57 user nova-compute[75469]: </domain>
Nov 14 04:51:57 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1216043162',display_name='tempest-AttachVolumeTestJSON-server-1216043162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1216043162',id=3,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmvdCBIfh48Eeknk9EcyhY/EUByia8dNJsdA49UBgYl79YeoAE1ZBCnXslVyMxP+0apbX7EEDT0C15puJDnVXndeeRGIR/eT6s8JeH6vqhOdqMbAiRlzvoMhvGWyeiHSA==',key_name='tempest-keypair-539876909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-s5b510vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=68c68428-4d79-4dd7-94a1-9c05e5230a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG os_vif [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1e8656f-16a2-578d-bfd2-34de9ddc4abe', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d0308df-4e, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d0308df-4e, col_values=(('qos', UUID('7175debc-ec19-43d8-8a53-c8fe00c3bde9')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d0308df-4e, col_values=(('external_ids', {'iface-id': '5d0308df-4ec4-495c-b85e-73900b018564', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:a7:a6', 'vm-uuid': '68c68428-4d79-4dd7-94a1-9c05e5230a8a'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:57 user nova-compute[75469]: INFO os_vif [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e')
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:51:57 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Creating image(s)
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "/opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "/opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No VIF found with MAC fa:16:3e:de:a7:a6, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.policy [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88fb3641cda04c96b925d7b83af359b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fb1cdf42b04f37b025ed7385c4af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.165s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk 1073741824" returned: 0 in 0.053s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Cannot resize image /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Ensure instance console log exists: /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.network.neutron [req-04864531-6314-45d7-aad6-195bdcdd9695 req-e7659d99-afad-4c68-9629-fcb16825d584 service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updated VIF entry in instance network info cache for port 46427af9-a17a-49dd-9905-509577765b07. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.network.neutron [req-04864531-6314-45d7-aad6-195bdcdd9695 req-e7659d99-afad-4c68-9629-fcb16825d584 service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updating instance_info_cache with network_info: [{"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-04864531-6314-45d7-aad6-195bdcdd9695 req-e7659d99-afad-4c68-9629-fcb16825d584 service nova] Releasing lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.network.neutron [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Successfully updated port: 45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquired lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.network.neutron [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.network.neutron [req-7effa4e6-2bfe-49cc-b838-0e90e7b7d4cf req-5bc6599b-4803-417a-8a4d-46c1374168b5 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updated VIF entry in instance network info cache for port 5d0308df-4ec4-495c-b85e-73900b018564. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.network.neutron [req-7effa4e6-2bfe-49cc-b838-0e90e7b7d4cf req-5bc6599b-4803-417a-8a4d-46c1374168b5 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updating instance_info_cache with network_info: [{"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7effa4e6-2bfe-49cc-b838-0e90e7b7d4cf req-5bc6599b-4803-417a-8a4d-46c1374168b5 service nova] Releasing lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-fcb07267-6153-4859-bd79-0614c0ac8cf4 req-9137e5bd-41b8-404c-be18-9e99b47824a1 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-changed-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-fcb07267-6153-4859-bd79-0614c0ac8cf4 req-9137e5bd-41b8-404c-be18-9e99b47824a1 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Refreshing instance network info cache due to event network-changed-45923d58-4176-482f-b9c0-6f871c90529c. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fcb07267-6153-4859-bd79-0614c0ac8cf4 req-9137e5bd-41b8-404c-be18-9e99b47824a1 service nova] Acquiring lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:51:58 user nova-compute[75469]: DEBUG nova.network.neutron [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.network.neutron [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating instance_info_cache with network_info: [{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Releasing lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance network_info: |[{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fcb07267-6153-4859-bd79-0614c0ac8cf4 req-9137e5bd-41b8-404c-be18-9e99b47824a1 service nova] Acquired lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.network.neutron [req-fcb07267-6153-4859-bd79-0614c0ac8cf4 req-9137e5bd-41b8-404c-be18-9e99b47824a1 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Refreshing network info cache for port 45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Start _get_guest_xml network_info=[{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:51:59 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:51:59 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-501716171',display_name='tempest-ServerActionsTestOtherB-server-501716171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-501716171',id=4,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCM9hFVe3wxoADlpmZS5pvsZqPL5+bIs5VB/4pYIHPJU3LZ6fFGC+bLXtjhSZVFtu7N4xdCrGz0UJgg9Kot0QzE0EwlPJEFb1NBTvEvGy/Q0Twm7zNyBzgTNIwdP75tUg==',key_name='tempest-keypair-1630737506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a921fed4277644dd9b75295d99c4af6b',ramdisk_id='',reservation_id='r-4b5895c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1992991016',owner_user_name='tempest-ServerActionsTestOtherB-1992991016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c089065dec4fbdaf39807c43265ecf',uuid=fb551839-7b5a-4ecd-b9c0-ab53addeaa45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converting VIF {"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.objects.instance [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lazy-loading 'pci_devices' on Instance uuid fb551839-7b5a-4ecd-b9c0-ab53addeaa45 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Successfully created port: d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:51:59 user nova-compute[75469]:   <uuid>fb551839-7b5a-4ecd-b9c0-ab53addeaa45</uuid>
Nov 14 04:51:59 user nova-compute[75469]:   <name>instance-00000004</name>
Nov 14 04:51:59 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:51:59 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:51:59 user nova-compute[75469]:   <metadata>
Nov 14 04:51:59 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:51:59 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:51:59 user nova-compute[75469]:       <nova:name>tempest-ServerActionsTestOtherB-server-501716171</nova:name>
Nov 14 04:51:59 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:51:59</nova:creationTime>
Nov 14 04:51:59 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:51:59 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:51:59 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:51:59 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:51:59 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:51:59 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:51:59 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:51:59 user nova-compute[75469]:       <nova:owner>
Nov 14 04:51:59 user nova-compute[75469]:         <nova:user uuid="73c089065dec4fbdaf39807c43265ecf">tempest-ServerActionsTestOtherB-1992991016-project-member</nova:user>
Nov 14 04:51:59 user nova-compute[75469]:         <nova:project uuid="a921fed4277644dd9b75295d99c4af6b">tempest-ServerActionsTestOtherB-1992991016</nova:project>
Nov 14 04:51:59 user nova-compute[75469]:       </nova:owner>
Nov 14 04:51:59 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:51:59 user nova-compute[75469]:       <nova:ports>
Nov 14 04:51:59 user nova-compute[75469]:         <nova:port uuid="45923d58-4176-482f-b9c0-6f871c90529c">
Nov 14 04:51:59 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 04:51:59 user nova-compute[75469]:         </nova:port>
Nov 14 04:51:59 user nova-compute[75469]:       </nova:ports>
Nov 14 04:51:59 user nova-compute[75469]:     </nova:instance>
Nov 14 04:51:59 user nova-compute[75469]:   </metadata>
Nov 14 04:51:59 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:51:59 user nova-compute[75469]:     <system>
Nov 14 04:51:59 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:51:59 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:51:59 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:51:59 user nova-compute[75469]:       <entry name="serial">fb551839-7b5a-4ecd-b9c0-ab53addeaa45</entry>
Nov 14 04:51:59 user nova-compute[75469]:       <entry name="uuid">fb551839-7b5a-4ecd-b9c0-ab53addeaa45</entry>
Nov 14 04:51:59 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:51:59 user nova-compute[75469]:     </system>
Nov 14 04:51:59 user nova-compute[75469]:   </sysinfo>
Nov 14 04:51:59 user nova-compute[75469]:   <os>
Nov 14 04:51:59 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:51:59 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:51:59 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:51:59 user nova-compute[75469]:   </os>
Nov 14 04:51:59 user nova-compute[75469]:   <features>
Nov 14 04:51:59 user nova-compute[75469]:     <acpi/>
Nov 14 04:51:59 user nova-compute[75469]:     <apic/>
Nov 14 04:51:59 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:51:59 user nova-compute[75469]:   </features>
Nov 14 04:51:59 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:51:59 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:51:59 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:51:59 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:51:59 user nova-compute[75469]:   </clock>
Nov 14 04:51:59 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:51:59 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:51:59 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:51:59 user nova-compute[75469]:   </cpu>
Nov 14 04:51:59 user nova-compute[75469]:   <devices>
Nov 14 04:51:59 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:51:59 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:51:59 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk"/>
Nov 14 04:51:59 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:51:59 user nova-compute[75469]:     </disk>
Nov 14 04:51:59 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:51:59 user nova-compute[75469]:       <mac address="fa:16:3e:44:d1:3e"/>
Nov 14 04:51:59 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:51:59 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:51:59 user nova-compute[75469]:       <target dev="tap45923d58-41"/>
Nov 14 04:51:59 user nova-compute[75469]:     </interface>
Nov 14 04:51:59 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:51:59 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/console.log" append="off"/>
Nov 14 04:51:59 user nova-compute[75469]:     </serial>
Nov 14 04:51:59 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:51:59 user nova-compute[75469]:     <video>
Nov 14 04:51:59 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:51:59 user nova-compute[75469]:     </video>
Nov 14 04:51:59 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:51:59 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:51:59 user nova-compute[75469]:     </rng>
Nov 14 04:51:59 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:51:59 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:51:59 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:51:59 user nova-compute[75469]:     </memballoon>
Nov 14 04:51:59 user nova-compute[75469]:   </devices>
Nov 14 04:51:59 user nova-compute[75469]: </domain>
Nov 14 04:51:59 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-501716171',display_name='tempest-ServerActionsTestOtherB-server-501716171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-501716171',id=4,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCM9hFVe3wxoADlpmZS5pvsZqPL5+bIs5VB/4pYIHPJU3LZ6fFGC+bLXtjhSZVFtu7N4xdCrGz0UJgg9Kot0QzE0EwlPJEFb1NBTvEvGy/Q0Twm7zNyBzgTNIwdP75tUg==',key_name='tempest-keypair-1630737506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a921fed4277644dd9b75295d99c4af6b',ramdisk_id='',reservation_id='r-4b5895c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1992991016',owner_user_name='tempest-ServerActionsTestOtherB-1992991016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c089065dec4fbdaf39807c43265ecf',uuid=fb551839-7b5a-4ecd-b9c0-ab53addeaa45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converting VIF {"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG os_vif [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ae442ef-a2b1-5c06-9bdc-f76ae96c415f', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45923d58-41, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45923d58-41, col_values=(('qos', UUID('f8423f2b-3aa4-4df6-b4a3-4f6e08a5e2d8')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45923d58-41, col_values=(('external_ids', {'iface-id': '45923d58-4176-482f-b9c0-6f871c90529c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:d1:3e', 'vm-uuid': 'fb551839-7b5a-4ecd-b9c0-ab53addeaa45'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:59 user nova-compute[75469]: INFO os_vif [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41')
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] No VIF found with MAC fa:16:3e:44:d1:3e, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:51:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG nova.network.neutron [req-fcb07267-6153-4859-bd79-0614c0ac8cf4 req-9137e5bd-41b8-404c-be18-9e99b47824a1 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updated VIF entry in instance network info cache for port 45923d58-4176-482f-b9c0-6f871c90529c. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG nova.network.neutron [req-fcb07267-6153-4859-bd79-0614c0ac8cf4 req-9137e5bd-41b8-404c-be18-9e99b47824a1 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating instance_info_cache with network_info: [{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fcb07267-6153-4859-bd79-0614c0ac8cf4 req-9137e5bd-41b8-404c-be18-9e99b47824a1 service nova] Releasing lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Successfully updated port: d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquired lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG nova.compute.manager [req-84ba079e-9e94-4944-addd-dda6f4c78c27 req-fdf3c2d3-c514-4085-815f-ad194c927720 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-changed-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG nova.compute.manager [req-84ba079e-9e94-4944-addd-dda6f4c78c27 req-fdf3c2d3-c514-4085-815f-ad194c927720 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Refreshing instance network info cache due to event network-changed-d5b49c15-8461-4b3c-aa57-0dcdd7b12305. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-84ba079e-9e94-4944-addd-dda6f4c78c27 req-fdf3c2d3-c514-4085-815f-ad194c927720 service nova] Acquiring lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating instance_info_cache with network_info: [{"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Releasing lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Instance network_info: |[{"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-84ba079e-9e94-4944-addd-dda6f4c78c27 req-fdf3c2d3-c514-4085-815f-ad194c927720 service nova] Acquired lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.network.neutron [req-84ba079e-9e94-4944-addd-dda6f4c78c27 req-fdf3c2d3-c514-4085-815f-ad194c927720 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Refreshing network info cache for port d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Start _get_guest_xml network_info=[{"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:52:01 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:01 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-864532062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-864532062',id=5,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJxiXPqJ+9+ZxyO6Uypnua2AMVUYfA5aTo9i6T6J9NsbMbvS1ODQw3d9jf076JfAUED2qfOIr52fC3va9mIfCd/X6AwXEVw/N/gscS3X8nizJZYWlkeEX3UqEz1ZSu22g==',key_name='tempest-keypair-1957997782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-458dg48g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:51:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=fbbae8e3-5d56-41ed-9be2-8856c3420f44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.objects.instance [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'pci_devices' on Instance uuid fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:52:01 user nova-compute[75469]:   <uuid>fbbae8e3-5d56-41ed-9be2-8856c3420f44</uuid>
Nov 14 04:52:01 user nova-compute[75469]:   <name>instance-00000005</name>
Nov 14 04:52:01 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:52:01 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:52:01 user nova-compute[75469]:   <metadata>
Nov 14 04:52:01 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:52:01 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:52:01 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-864532062</nova:name>
Nov 14 04:52:01 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:52:01</nova:creationTime>
Nov 14 04:52:01 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:52:01 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:52:01 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:52:01 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:52:01 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:52:01 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:52:01 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:52:01 user nova-compute[75469]:       <nova:owner>
Nov 14 04:52:01 user nova-compute[75469]:         <nova:user uuid="88fb3641cda04c96b925d7b83af359b6">tempest-AttachVolumeShelveTestJSON-41564664-project-member</nova:user>
Nov 14 04:52:01 user nova-compute[75469]:         <nova:project uuid="95fb1cdf42b04f37b025ed7385c4af37">tempest-AttachVolumeShelveTestJSON-41564664</nova:project>
Nov 14 04:52:01 user nova-compute[75469]:       </nova:owner>
Nov 14 04:52:01 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:52:01 user nova-compute[75469]:       <nova:ports>
Nov 14 04:52:01 user nova-compute[75469]:         <nova:port uuid="d5b49c15-8461-4b3c-aa57-0dcdd7b12305">
Nov 14 04:52:01 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 04:52:01 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:01 user nova-compute[75469]:       </nova:ports>
Nov 14 04:52:01 user nova-compute[75469]:     </nova:instance>
Nov 14 04:52:01 user nova-compute[75469]:   </metadata>
Nov 14 04:52:01 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:52:01 user nova-compute[75469]:     <system>
Nov 14 04:52:01 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:52:01 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:52:01 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:52:01 user nova-compute[75469]:       <entry name="serial">fbbae8e3-5d56-41ed-9be2-8856c3420f44</entry>
Nov 14 04:52:01 user nova-compute[75469]:       <entry name="uuid">fbbae8e3-5d56-41ed-9be2-8856c3420f44</entry>
Nov 14 04:52:01 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:52:01 user nova-compute[75469]:     </system>
Nov 14 04:52:01 user nova-compute[75469]:   </sysinfo>
Nov 14 04:52:01 user nova-compute[75469]:   <os>
Nov 14 04:52:01 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:52:01 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:52:01 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:52:01 user nova-compute[75469]:   </os>
Nov 14 04:52:01 user nova-compute[75469]:   <features>
Nov 14 04:52:01 user nova-compute[75469]:     <acpi/>
Nov 14 04:52:01 user nova-compute[75469]:     <apic/>
Nov 14 04:52:01 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:52:01 user nova-compute[75469]:   </features>
Nov 14 04:52:01 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:52:01 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:52:01 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:52:01 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:52:01 user nova-compute[75469]:   </clock>
Nov 14 04:52:01 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:52:01 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:52:01 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:52:01 user nova-compute[75469]:   </cpu>
Nov 14 04:52:01 user nova-compute[75469]:   <devices>
Nov 14 04:52:01 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:52:01 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:52:01 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk"/>
Nov 14 04:52:01 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:52:01 user nova-compute[75469]:     </disk>
Nov 14 04:52:01 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:01 user nova-compute[75469]:       <mac address="fa:16:3e:a9:9c:ef"/>
Nov 14 04:52:01 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:01 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:01 user nova-compute[75469]:       <target dev="tapd5b49c15-84"/>
Nov 14 04:52:01 user nova-compute[75469]:     </interface>
Nov 14 04:52:01 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:52:01 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/console.log" append="off"/>
Nov 14 04:52:01 user nova-compute[75469]:     </serial>
Nov 14 04:52:01 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:52:01 user nova-compute[75469]:     <video>
Nov 14 04:52:01 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:01 user nova-compute[75469]:     </video>
Nov 14 04:52:01 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:52:01 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:52:01 user nova-compute[75469]:     </rng>
Nov 14 04:52:01 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:52:01 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:52:01 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:52:01 user nova-compute[75469]:     </memballoon>
Nov 14 04:52:01 user nova-compute[75469]:   </devices>
Nov 14 04:52:01 user nova-compute[75469]: </domain>
Nov 14 04:52:01 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-864532062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-864532062',id=5,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJxiXPqJ+9+ZxyO6Uypnua2AMVUYfA5aTo9i6T6J9NsbMbvS1ODQw3d9jf076JfAUED2qfOIr52fC3va9mIfCd/X6AwXEVw/N/gscS3X8nizJZYWlkeEX3UqEz1ZSu22g==',key_name='tempest-keypair-1957997782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-458dg48g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:51:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=fbbae8e3-5d56-41ed-9be2-8856c3420f44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG os_vif [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dbb41d3-d57d-5f07-a62f-f6e2581d55c7', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5b49c15-84, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5b49c15-84, col_values=(('qos', UUID('96e22a3e-a3c7-4c74-a7ba-8c02d34df896')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5b49c15-84, col_values=(('external_ids', {'iface-id': 'd5b49c15-8461-4b3c-aa57-0dcdd7b12305', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:9c:ef', 'vm-uuid': 'fbbae8e3-5d56-41ed-9be2-8856c3420f44'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:01 user nova-compute[75469]: INFO os_vif [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84')
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] No VIF found with MAC fa:16:3e:a9:9c:ef, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.network.neutron [req-84ba079e-9e94-4944-addd-dda6f4c78c27 req-fdf3c2d3-c514-4085-815f-ad194c927720 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updated VIF entry in instance network info cache for port d5b49c15-8461-4b3c-aa57-0dcdd7b12305. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG nova.network.neutron [req-84ba079e-9e94-4944-addd-dda6f4c78c27 req-fdf3c2d3-c514-4085-815f-ad194c927720 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating instance_info_cache with network_info: [{"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-84ba079e-9e94-4944-addd-dda6f4c78c27 req-fdf3c2d3-c514-4085-815f-ad194c927720 service nova] Releasing lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:52:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance spawned successfully.
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:52:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Instance spawned successfully.
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:04 user nova-compute[75469]: INFO nova.compute.manager [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Took 12.19 seconds to spawn the instance on the hypervisor.
Nov 14 04:52:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:52:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:05 user nova-compute[75469]: INFO nova.compute.manager [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Took 13.29 seconds to build instance.
Nov 14 04:52:05 user nova-compute[75469]: INFO nova.compute.manager [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Took 15.01 seconds to spawn the instance on the hypervisor.
Nov 14 04:52:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:52:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f25564d4-b752-47f7-b46d-349187bfaa9a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.474s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:05 user nova-compute[75469]: INFO nova.compute.manager [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Took 15.99 seconds to build instance.
Nov 14 04:52:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-761fc626-b298-4e9c-80ca-41019dbd0f90 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.327s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:52:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:52:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Instance spawned successfully.
Nov 14 04:52:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:52:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:06 user nova-compute[75469]: INFO nova.compute.manager [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Took 18.22 seconds to spawn the instance on the hypervisor.
Nov 14 04:52:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:52:06 user nova-compute[75469]: INFO nova.compute.manager [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Took 19.49 seconds to build instance.
Nov 14 04:52:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-040410dd-fc53-4c45-84c0-1cf4da3cdf34 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.716s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:52:07 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance spawned successfully.
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:52:07 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Instance spawned successfully.
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:07 user nova-compute[75469]: INFO nova.compute.manager [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Took 9.98 seconds to spawn the instance on the hypervisor.
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:52:07 user nova-compute[75469]: INFO nova.compute.manager [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Took 12.47 seconds to spawn the instance on the hypervisor.
Nov 14 04:52:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:52:07 user nova-compute[75469]: INFO nova.compute.manager [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Took 14.08 seconds to build instance.
Nov 14 04:52:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49af82cf-923f-4476-b136-25b908310189 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.189s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:07 user nova-compute[75469]: INFO nova.compute.manager [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Took 11.06 seconds to build instance.
Nov 14 04:52:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf07a21e-3bff-4e6b-968d-5686fbdf698c tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.188s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "0faef65d-62e0-4d48-92d5-f50395b7d190" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:12 user nova-compute[75469]: DEBUG nova.compute.manager [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:52:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:52:12 user nova-compute[75469]: INFO nova.compute.claims [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Claim successful on node user
Nov 14 04:52:12 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:52:12 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG nova.network.neutron [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:52:13 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:52:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:52:13 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Creating image(s)
Nov 14 04:52:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "/opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "/opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "/opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG nova.policy [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb5695c4e5d74c269678220aa4e1b9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2c1e6fdb7497aab43cd768f8ea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.298s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.413s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk 1073741824" returned: 0 in 0.111s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.534s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.259s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG nova.network.neutron [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Successfully created port: 9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Cannot resize image /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Ensure instance console log exists: /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:52:15 user nova-compute[75469]: INFO nova.compute.claims [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Claim successful on node user
Nov 14 04:52:15 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:52:15 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:52:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:52:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:52:15 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:52:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:52:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:52:15 user nova-compute[75469]: INFO nova.virt.block_device [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Booting with volume b6d71d08-ba53-43c2-955e-526da6f4836d at /dev/vda
Nov 14 04:52:15 user nova-compute[75469]: DEBUG nova.policy [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '149fe6f4b2584ddb98cce41ca1f943fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb898273020b4563966aedc3204042c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG os_brick.utils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:52:16 user nova-compute[75469]: INFO oslo.privsep.daemon [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp6_dq1qqp/privsep.sock']
Nov 14 04:52:16 user sudo[85521]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp6_dq1qqp/privsep.sock
Nov 14 04:52:16 user sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 04:52:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:52:16 user nova-compute[75469]: INFO nova.compute.claims [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Claim successful on node user
Nov 14 04:52:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Successfully updated port: 9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquired lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-893d9e77-5d83-4fed-ada1-39b89a7a680b req-93e527ac-6d9a-47e9-b9f2-feba7796e1bc service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Received event network-changed-9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-893d9e77-5d83-4fed-ada1-39b89a7a680b req-93e527ac-6d9a-47e9-b9f2-feba7796e1bc service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Refreshing instance network info cache due to event network-changed-9c3ca113-2c42-477e-9a19-7e00ef90718c. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-893d9e77-5d83-4fed-ada1-39b89a7a680b req-93e527ac-6d9a-47e9-b9f2-feba7796e1bc service nova] Acquiring lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG nova.network.neutron [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:52:17 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:52:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:52:17 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Creating image(s)
Nov 14 04:52:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "/opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "/opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:52:17 user nova-compute[75469]: DEBUG nova.policy [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a159887ca76a474cad961ff2e63160de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc8d826c76141c092339f38b74c6f79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.248s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Successfully created port: f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:52:18 user nova-compute[75469]: INFO nova.compute.claims [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Claim successful on node user
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Updating instance_info_cache with network_info: [{"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Releasing lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Instance network_info: |[{"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-893d9e77-5d83-4fed-ada1-39b89a7a680b req-93e527ac-6d9a-47e9-b9f2-feba7796e1bc service nova] Acquired lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.network.neutron [req-893d9e77-5d83-4fed-ada1-39b89a7a680b req-93e527ac-6d9a-47e9-b9f2-feba7796e1bc service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Refreshing network info cache for port 9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Start _get_guest_xml network_info=[{"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.247s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk 1073741824" returned: 0 in 0.080s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:18 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:18 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-840621284',display_name='tempest-VolumesAdminNegativeTest-server-840621284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-840621284',id=6,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtdodjnzuuNxBy5CZAVNizX3irMrNo0a7oAD2sDIxmD18ymMcjDTrZtYn5hER1EQ6w9kRQtU410cnBB7rZJktdTMNW0ELNj4PMUveuXafBBiHl4pQSBV33pu3oQHWwP2Q==',key_name='tempest-keypair-505199733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c2c1e6fdb7497aab43cd768f8ea236',ramdisk_id='',reservation_id='r-l5xr0y8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1455966896',owner_user_name='tempest-VolumesAdminNegativeTest-1455966896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5695c4e5d74c269678220aa4e1b9bf',uuid=0faef65d-62e0-4d48-92d5-f50395b7d190,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converting VIF {"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:18 user sudo[85521]: pam_unix(sudo:session): session closed for user root
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:31:86,bridge_name='br-int',has_traffic_filtering=True,id=9c3ca113-2c42-477e-9a19-7e00ef90718c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3ca113-2c') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.objects.instance [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lazy-loading 'pci_devices' on Instance uuid 0faef65d-62e0-4d48-92d5-f50395b7d190 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:52:18 user nova-compute[75469]: INFO oslo.privsep.daemon [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Spawned new privsep daemon via rootwrap
Nov 14 04:52:18 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 04:52:18 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 04:52:18 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 04:52:18 user nova-compute[75469]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85531
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:52:18 user nova-compute[75469]:   <uuid>0faef65d-62e0-4d48-92d5-f50395b7d190</uuid>
Nov 14 04:52:18 user nova-compute[75469]:   <name>instance-00000006</name>
Nov 14 04:52:18 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:52:18 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:52:18 user nova-compute[75469]:   <metadata>
Nov 14 04:52:18 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:52:18 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:52:18 user nova-compute[75469]:       <nova:name>tempest-VolumesAdminNegativeTest-server-840621284</nova:name>
Nov 14 04:52:18 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:52:18</nova:creationTime>
Nov 14 04:52:18 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:52:18 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:52:18 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:52:18 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:52:18 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:52:18 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:52:18 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:52:18 user nova-compute[75469]:       <nova:owner>
Nov 14 04:52:18 user nova-compute[75469]:         <nova:user uuid="cb5695c4e5d74c269678220aa4e1b9bf">tempest-VolumesAdminNegativeTest-1455966896-project-member</nova:user>
Nov 14 04:52:18 user nova-compute[75469]:         <nova:project uuid="94c2c1e6fdb7497aab43cd768f8ea236">tempest-VolumesAdminNegativeTest-1455966896</nova:project>
Nov 14 04:52:18 user nova-compute[75469]:       </nova:owner>
Nov 14 04:52:18 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:52:18 user nova-compute[75469]:       <nova:ports>
Nov 14 04:52:18 user nova-compute[75469]:         <nova:port uuid="9c3ca113-2c42-477e-9a19-7e00ef90718c">
Nov 14 04:52:18 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 04:52:18 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:18 user nova-compute[75469]:       </nova:ports>
Nov 14 04:52:18 user nova-compute[75469]:     </nova:instance>
Nov 14 04:52:18 user nova-compute[75469]:   </metadata>
Nov 14 04:52:18 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:52:18 user nova-compute[75469]:     <system>
Nov 14 04:52:18 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:52:18 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:52:18 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:52:18 user nova-compute[75469]:       <entry name="serial">0faef65d-62e0-4d48-92d5-f50395b7d190</entry>
Nov 14 04:52:18 user nova-compute[75469]:       <entry name="uuid">0faef65d-62e0-4d48-92d5-f50395b7d190</entry>
Nov 14 04:52:18 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:52:18 user nova-compute[75469]:     </system>
Nov 14 04:52:18 user nova-compute[75469]:   </sysinfo>
Nov 14 04:52:18 user nova-compute[75469]:   <os>
Nov 14 04:52:18 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:52:18 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:52:18 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:52:18 user nova-compute[75469]:   </os>
Nov 14 04:52:18 user nova-compute[75469]:   <features>
Nov 14 04:52:18 user nova-compute[75469]:     <acpi/>
Nov 14 04:52:18 user nova-compute[75469]:     <apic/>
Nov 14 04:52:18 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:52:18 user nova-compute[75469]:   </features>
Nov 14 04:52:18 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:52:18 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:52:18 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:52:18 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:52:18 user nova-compute[75469]:   </clock>
Nov 14 04:52:18 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:52:18 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:52:18 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:52:18 user nova-compute[75469]:   </cpu>
Nov 14 04:52:18 user nova-compute[75469]:   <devices>
Nov 14 04:52:18 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:52:18 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:52:18 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk"/>
Nov 14 04:52:18 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:52:18 user nova-compute[75469]:     </disk>
Nov 14 04:52:18 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:18 user nova-compute[75469]:       <mac address="fa:16:3e:73:31:86"/>
Nov 14 04:52:18 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:18 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:18 user nova-compute[75469]:       <target dev="tap9c3ca113-2c"/>
Nov 14 04:52:18 user nova-compute[75469]:     </interface>
Nov 14 04:52:18 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:52:18 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/console.log" append="off"/>
Nov 14 04:52:18 user nova-compute[75469]:     </serial>
Nov 14 04:52:18 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:52:18 user nova-compute[75469]:     <video>
Nov 14 04:52:18 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:18 user nova-compute[75469]:     </video>
Nov 14 04:52:18 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:52:18 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:52:18 user nova-compute[75469]:     </rng>
Nov 14 04:52:18 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:52:18 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:52:18 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:52:18 user nova-compute[75469]:     </memballoon>
Nov 14 04:52:18 user nova-compute[75469]:   </devices>
Nov 14 04:52:18 user nova-compute[75469]: </domain>
Nov 14 04:52:18 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-840621284',display_name='tempest-VolumesAdminNegativeTest-server-840621284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-840621284',id=6,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtdodjnzuuNxBy5CZAVNizX3irMrNo0a7oAD2sDIxmD18ymMcjDTrZtYn5hER1EQ6w9kRQtU410cnBB7rZJktdTMNW0ELNj4PMUveuXafBBiHl4pQSBV33pu3oQHWwP2Q==',key_name='tempest-keypair-505199733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c2c1e6fdb7497aab43cd768f8ea236',ramdisk_id='',reservation_id='r-l5xr0y8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1455966896',owner_user_name='tempest-VolumesAdminNegativeTest-1455966896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5695c4e5d74c269678220aa4e1b9bf',uuid=0faef65d-62e0-4d48-92d5-f50395b7d190,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converting VIF {"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:31:86,bridge_name='br-int',has_traffic_filtering=True,id=9c3ca113-2c42-477e-9a19-7e00ef90718c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3ca113-2c') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG os_vif [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:31:86,bridge_name='br-int',has_traffic_filtering=True,id=9c3ca113-2c42-477e-9a19-7e00ef90718c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3ca113-2c') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a30ddc6-784e-512d-a3f5-dd64d1ba8d3e', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7694fcea-7995-4fc0-96b2-2b0d73366d25]: (2,) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c3ca113-2c, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c3ca113-2c, col_values=(('qos', UUID('6aabdd33-472b-45c8-b96c-605043936357')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c3ca113-2c, col_values=(('external_ids', {'iface-id': '9c3ca113-2c42-477e-9a19-7e00ef90718c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:31:86', 'vm-uuid': '0faef65d-62e0-4d48-92d5-f50395b7d190'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:18 user nova-compute[75469]: INFO os_vif [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:31:86,bridge_name='br-int',has_traffic_filtering=True,id=9c3ca113-2c42-477e-9a19-7e00ef90718c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3ca113-2c')
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.337s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] No VIF found with MAC fa:16:3e:73:31:86, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.035s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6282c7dd-cc2b-4fd5-a077-ed0ef20b3233]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:18 user nova-compute[75469]: WARNING os_brick.initiator.connectors.nvmeof [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4f46ab-42da-4d5b-b747-b00dbf48482a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.036s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb90ab6-a887-46bb-99de-bc557f9066fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c2c9dd-430c-43f3-9446-163f24b648f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:52:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Cannot resize image /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Ensure instance console log exists: /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:52:19 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c972a10a-6262-4285-8381-f6e0d5155fe4]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG os_brick.utils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] <== get_connector_properties: return (2934ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Updating existing volume attachment record: dcb2dcd3-cd72-4669-bc84-be6383f47355 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.990s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:52:19 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:52:19 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Creating image(s)
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "/opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "/opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "/opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "071f76e21050dae1318aab8fd4b36890014ae7c7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f76e21050dae1318aab8fd4b36890014ae7c7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7.part --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:19 user nova-compute[75469]: DEBUG nova.policy [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f44394442ce34cda9a0f4f4d17fab163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84e416fb9684a249adb4fca64d871e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7.part --force-share --output=json" returned: 0 in 0.261s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG nova.virt.images [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] 2372ddfc-76a1-42de-b11b-2aeeccfffbb1 was qcow2, converting to raw {{(pid=75469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7.part /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7.converted {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG nova.network.neutron [req-893d9e77-5d83-4fed-ada1-39b89a7a680b req-93e527ac-6d9a-47e9-b9f2-feba7796e1bc service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Updated VIF entry in instance network info cache for port 9c3ca113-2c42-477e-9a19-7e00ef90718c. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG nova.network.neutron [req-893d9e77-5d83-4fed-ada1-39b89a7a680b req-93e527ac-6d9a-47e9-b9f2-feba7796e1bc service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Updating instance_info_cache with network_info: [{"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-893d9e77-5d83-4fed-ada1-39b89a7a680b req-93e527ac-6d9a-47e9-b9f2-feba7796e1bc service nova] Releasing lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7.part /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7.converted" returned: 0 in 0.272s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7.converted --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7.converted --force-share --output=json" returned: 0 in 0.304s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f76e21050dae1318aab8fd4b36890014ae7c7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.385s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:20 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Successfully created port: aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Successfully created port: 5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Successfully updated port: f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "refresh_cache-ccd1b71a-7ecb-4060-bb65-e635222bfcd7" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquired lock "refresh_cache-ccd1b71a-7ecb-4060-bb65-e635222bfcd7" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7 --force-share --output=json" returned: 0 in 0.392s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "071f76e21050dae1318aab8fd4b36890014ae7c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f76e21050dae1318aab8fd4b36890014ae7c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-1380b3d6-f08e-48a2-ab8c-864e4e8549e8 req-8466242b-7627-4438-a1a7-e4c4eff5cbf2 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-changed-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-1380b3d6-f08e-48a2-ab8c-864e4e8549e8 req-8466242b-7627-4438-a1a7-e4c4eff5cbf2 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Refreshing instance network info cache due to event network-changed-f7e4eb96-0f42-46e0-a34c-54749e5d33b9. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1380b3d6-f08e-48a2-ab8c-864e4e8549e8 req-8466242b-7627-4438-a1a7-e4c4eff5cbf2 service nova] Acquiring lock "refresh_cache-ccd1b71a-7ecb-4060-bb65-e635222bfcd7" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:52:21 user nova-compute[75469]: INFO nova.compute.claims [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Claim successful on node user
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7 --force-share --output=json" returned: 0 in 0.229s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7,backing_fmt=raw /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7,backing_fmt=raw /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk 1073741824" returned: 0 in 0.072s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f76e21050dae1318aab8fd4b36890014ae7c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Successfully updated port: aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7 --force-share --output=json" returned: 0 in 0.282s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "refresh_cache-071f97b4-296b-43aa-8fa9-cf0a69c9764d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquired lock "refresh_cache-071f97b4-296b-43aa-8fa9-cf0a69c9764d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-bf06ba20-c4ea-4196-8fd8-0857583bea4e req-14af2c69-c454-4623-80df-c7d1faa73556 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Received event network-changed-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-bf06ba20-c4ea-4196-8fd8-0857583bea4e req-14af2c69-c454-4623-80df-c7d1faa73556 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Refreshing instance network info cache due to event network-changed-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bf06ba20-c4ea-4196-8fd8-0857583bea4e req-14af2c69-c454-4623-80df-c7d1faa73556 service nova] Acquiring lock "refresh_cache-071f97b4-296b-43aa-8fa9-cf0a69c9764d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk --force-share --output=json" returned: 0 in 0.465s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Cannot resize image /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Ensure instance console log exists: /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Updating instance_info_cache with network_info: [{"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Releasing lock "refresh_cache-ccd1b71a-7ecb-4060-bb65-e635222bfcd7" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Instance network_info: |[{"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1380b3d6-f08e-48a2-ab8c-864e4e8549e8 req-8466242b-7627-4438-a1a7-e4c4eff5cbf2 service nova] Acquired lock "refresh_cache-ccd1b71a-7ecb-4060-bb65-e635222bfcd7" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.network.neutron [req-1380b3d6-f08e-48a2-ab8c-864e4e8549e8 req-8466242b-7627-4438-a1a7-e4c4eff5cbf2 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Refreshing network info cache for port f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Updating instance_info_cache with network_info: [{"id": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "address": "fa:16:3e:13:c1:05", "network": {"id": "daa70d61-704e-4a88-ab73-98f56391d1f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-839348841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84e416fb9684a249adb4fca64d871e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa599f35-2b", "ovs_interfaceid": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Releasing lock "refresh_cache-071f97b4-296b-43aa-8fa9-cf0a69c9764d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Instance network_info: |[{"id": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "address": "fa:16:3e:13:c1:05", "network": {"id": "daa70d61-704e-4a88-ab73-98f56391d1f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-839348841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84e416fb9684a249adb4fca64d871e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa599f35-2b", "ovs_interfaceid": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bf06ba20-c4ea-4196-8fd8-0857583bea4e req-14af2c69-c454-4623-80df-c7d1faa73556 service nova] Acquired lock "refresh_cache-071f97b4-296b-43aa-8fa9-cf0a69c9764d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.network.neutron [req-bf06ba20-c4ea-4196-8fd8-0857583bea4e req-14af2c69-c454-4623-80df-c7d1faa73556 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Refreshing network info cache for port aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Start _get_guest_xml network_info=[{"id": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "address": "fa:16:3e:13:c1:05", "network": {"id": "daa70d61-704e-4a88-ab73-98f56391d1f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-839348841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84e416fb9684a249adb4fca64d871e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa599f35-2b", "ovs_interfaceid": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:52:07Z,direct_url=<?>,disk_format='qcow2',id=2372ddfc-76a1-42de-b11b-2aeeccfffbb1,min_disk=0,min_ram=0,name='',owner='fe44ba39018642f3bc31b77d125b64df',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:52:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'disk_bus': 'scsi', 'encrypted': False, 'image_id': '2372ddfc-76a1-42de-b11b-2aeeccfffbb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.357s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:52:22 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:22 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:52:07Z,direct_url=<?>,disk_format='qcow2',id=2372ddfc-76a1-42de-b11b-2aeeccfffbb1,min_disk=0,min_ram=0,name='',owner='fe44ba39018642f3bc31b77d125b64df',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:52:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-347133932',display_name='tempest-AttachSCSIVolumeTestJSON-server-347133932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-347133932',id=9,image_ref='2372ddfc-76a1-42de-b11b-2aeeccfffbb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPmEDao1Vq9rnMu3Ihnzex39gY31OtW0AM194OCxUvM1vc2XGNh1iiP88VMfCs5omiQf6MblTQ0meGETZDc/4TZw7Pqbt05OiZg5yqbSrJ2rK21U3hGFKsTrBFzWUIQ2A==',key_name='tempest-keypair-1133741573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84e416fb9684a249adb4fca64d871e4',ramdisk_id='',reservation_id='r-4ns8c5b9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2372ddfc-76a1-42de-b11b-2aeeccfffbb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-745995412',owner_user_name='tempest-AttachSCSIVolumeTestJSON-745995412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f44394442ce34cda9a0f4f4d17fab163',uuid=071f97b4-296b-43aa-8fa9-cf0a69c9764d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "address": "fa:16:3e:13:c1:05", "network": {"id": "daa70d61-704e-4a88-ab73-98f56391d1f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-839348841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84e416fb9684a249adb4fca64d871e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa599f35-2b", "ovs_interfaceid": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Converting VIF {"id": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "address": "fa:16:3e:13:c1:05", "network": {"id": "daa70d61-704e-4a88-ab73-98f56391d1f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-839348841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84e416fb9684a249adb4fca64d871e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa599f35-2b", "ovs_interfaceid": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:c1:05,bridge_name='br-int',has_traffic_filtering=True,id=aa599f35-2b08-4d29-9b68-fecf5f4fcaa8,network=Network(daa70d61-704e-4a88-ab73-98f56391d1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa599f35-2b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.objects.instance [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lazy-loading 'pci_devices' on Instance uuid 071f97b4-296b-43aa-8fa9-cf0a69c9764d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:52:22 user nova-compute[75469]:   <uuid>071f97b4-296b-43aa-8fa9-cf0a69c9764d</uuid>
Nov 14 04:52:22 user nova-compute[75469]:   <name>instance-00000009</name>
Nov 14 04:52:22 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:52:22 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:52:22 user nova-compute[75469]:   <metadata>
Nov 14 04:52:22 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:52:22 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:52:22 user nova-compute[75469]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-347133932</nova:name>
Nov 14 04:52:22 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:52:22</nova:creationTime>
Nov 14 04:52:22 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:52:22 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:52:22 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:52:22 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:52:22 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:52:22 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:52:22 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:52:22 user nova-compute[75469]:       <nova:owner>
Nov 14 04:52:22 user nova-compute[75469]:         <nova:user uuid="f44394442ce34cda9a0f4f4d17fab163">tempest-AttachSCSIVolumeTestJSON-745995412-project-member</nova:user>
Nov 14 04:52:22 user nova-compute[75469]:         <nova:project uuid="a84e416fb9684a249adb4fca64d871e4">tempest-AttachSCSIVolumeTestJSON-745995412</nova:project>
Nov 14 04:52:22 user nova-compute[75469]:       </nova:owner>
Nov 14 04:52:22 user nova-compute[75469]:       <nova:root type="image" uuid="2372ddfc-76a1-42de-b11b-2aeeccfffbb1"/>
Nov 14 04:52:22 user nova-compute[75469]:       <nova:ports>
Nov 14 04:52:22 user nova-compute[75469]:         <nova:port uuid="aa599f35-2b08-4d29-9b68-fecf5f4fcaa8">
Nov 14 04:52:22 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 04:52:22 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:22 user nova-compute[75469]:       </nova:ports>
Nov 14 04:52:22 user nova-compute[75469]:     </nova:instance>
Nov 14 04:52:22 user nova-compute[75469]:   </metadata>
Nov 14 04:52:22 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:52:22 user nova-compute[75469]:     <system>
Nov 14 04:52:22 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:52:22 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:52:22 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:52:22 user nova-compute[75469]:       <entry name="serial">071f97b4-296b-43aa-8fa9-cf0a69c9764d</entry>
Nov 14 04:52:22 user nova-compute[75469]:       <entry name="uuid">071f97b4-296b-43aa-8fa9-cf0a69c9764d</entry>
Nov 14 04:52:22 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:52:22 user nova-compute[75469]:     </system>
Nov 14 04:52:22 user nova-compute[75469]:   </sysinfo>
Nov 14 04:52:22 user nova-compute[75469]:   <os>
Nov 14 04:52:22 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:52:22 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:52:22 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:52:22 user nova-compute[75469]:   </os>
Nov 14 04:52:22 user nova-compute[75469]:   <features>
Nov 14 04:52:22 user nova-compute[75469]:     <acpi/>
Nov 14 04:52:22 user nova-compute[75469]:     <apic/>
Nov 14 04:52:22 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:52:22 user nova-compute[75469]:   </features>
Nov 14 04:52:22 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:52:22 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:52:22 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:52:22 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:52:22 user nova-compute[75469]:   </clock>
Nov 14 04:52:22 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:52:22 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:52:22 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:52:22 user nova-compute[75469]:   </cpu>
Nov 14 04:52:22 user nova-compute[75469]:   <devices>
Nov 14 04:52:22 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:52:22 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:52:22 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk"/>
Nov 14 04:52:22 user nova-compute[75469]:       <target dev="sda" bus="scsi"/>
Nov 14 04:52:22 user nova-compute[75469]:       <address type="drive" controller="0" unit="0"/>
Nov 14 04:52:22 user nova-compute[75469]:     </disk>
Nov 14 04:52:22 user nova-compute[75469]:     <disk type="file" device="cdrom">
Nov 14 04:52:22 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 04:52:22 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk.config"/>
Nov 14 04:52:22 user nova-compute[75469]:       <target dev="sdb" bus="scsi"/>
Nov 14 04:52:22 user nova-compute[75469]:       <address type="drive" controller="0" unit="1"/>
Nov 14 04:52:22 user nova-compute[75469]:     </disk>
Nov 14 04:52:22 user nova-compute[75469]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 04:52:22 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:22 user nova-compute[75469]:       <mac address="fa:16:3e:13:c1:05"/>
Nov 14 04:52:22 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:22 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:22 user nova-compute[75469]:       <target dev="tapaa599f35-2b"/>
Nov 14 04:52:22 user nova-compute[75469]:     </interface>
Nov 14 04:52:22 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:52:22 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/console.log" append="off"/>
Nov 14 04:52:22 user nova-compute[75469]:     </serial>
Nov 14 04:52:22 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:52:22 user nova-compute[75469]:     <video>
Nov 14 04:52:22 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:22 user nova-compute[75469]:     </video>
Nov 14 04:52:22 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:52:22 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:52:22 user nova-compute[75469]:     </rng>
Nov 14 04:52:22 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:52:22 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:52:22 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:52:22 user nova-compute[75469]:     </memballoon>
Nov 14 04:52:22 user nova-compute[75469]:   </devices>
Nov 14 04:52:22 user nova-compute[75469]: </domain>
Nov 14 04:52:22 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-347133932',display_name='tempest-AttachSCSIVolumeTestJSON-server-347133932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-347133932',id=9,image_ref='2372ddfc-76a1-42de-b11b-2aeeccfffbb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPmEDao1Vq9rnMu3Ihnzex39gY31OtW0AM194OCxUvM1vc2XGNh1iiP88VMfCs5omiQf6MblTQ0meGETZDc/4TZw7Pqbt05OiZg5yqbSrJ2rK21U3hGFKsTrBFzWUIQ2A==',key_name='tempest-keypair-1133741573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84e416fb9684a249adb4fca64d871e4',ramdisk_id='',reservation_id='r-4ns8c5b9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2372ddfc-76a1-42de-b11b-2aeeccfffbb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-745995412',owner_user_name='tempest-AttachSCSIVolumeTestJSON-745995412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f44394442ce34cda9a0f4f4d17fab163',uuid=071f97b4-296b-43aa-8fa9-cf0a69c9764d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "address": "fa:16:3e:13:c1:05", "network": {"id": "daa70d61-704e-4a88-ab73-98f56391d1f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-839348841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84e416fb9684a249adb4fca64d871e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa599f35-2b", "ovs_interfaceid": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Converting VIF {"id": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "address": "fa:16:3e:13:c1:05", "network": {"id": "daa70d61-704e-4a88-ab73-98f56391d1f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-839348841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84e416fb9684a249adb4fca64d871e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa599f35-2b", "ovs_interfaceid": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:c1:05,bridge_name='br-int',has_traffic_filtering=True,id=aa599f35-2b08-4d29-9b68-fecf5f4fcaa8,network=Network(daa70d61-704e-4a88-ab73-98f56391d1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa599f35-2b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG os_vif [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:c1:05,bridge_name='br-int',has_traffic_filtering=True,id=aa599f35-2b08-4d29-9b68-fecf5f4fcaa8,network=Network(daa70d61-704e-4a88-ab73-98f56391d1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa599f35-2b') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f93e5aa4-7b86-5532-b782-926dbbe80c8e', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa599f35-2b, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa599f35-2b, col_values=(('qos', UUID('2acd4dda-02dc-4dbc-b3fb-c83456abf2d4')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa599f35-2b, col_values=(('external_ids', {'iface-id': 'aa599f35-2b08-4d29-9b68-fecf5f4fcaa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:c1:05', 'vm-uuid': '071f97b4-296b-43aa-8fa9-cf0a69c9764d'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:22 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:52:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:22 user nova-compute[75469]: INFO os_vif [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:c1:05,bridge_name='br-int',has_traffic_filtering=True,id=aa599f35-2b08-4d29-9b68-fecf5f4fcaa8,network=Network(daa70d61-704e-4a88-ab73-98f56391d1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa599f35-2b')
Nov 14 04:52:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] No BDM found with device name sda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] No VIF found with MAC fa:16:3e:13:c1:05, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:52:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Using config drive
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:52:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Creating image(s)
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Successfully updated port: 5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "refresh_cache-1ab6379f-1ffa-4852-a00f-b498b39a2f3d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquired lock "refresh_cache-1ab6379f-1ffa-4852-a00f-b498b39a2f3d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.policy [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4371d2e15d6486b8b6aafd72905b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab74b837d742b2bf746eaf0f8a8d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:52:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Instance spawned successfully.
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.326s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-bf06ba20-c4ea-4196-8fd8-0857583bea4e req-14af2c69-c454-4623-80df-c7d1faa73556 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Updated VIF entry in instance network info cache for port aa599f35-2b08-4d29-9b68-fecf5f4fcaa8. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-bf06ba20-c4ea-4196-8fd8-0857583bea4e req-14af2c69-c454-4623-80df-c7d1faa73556 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Updating instance_info_cache with network_info: [{"id": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "address": "fa:16:3e:13:c1:05", "network": {"id": "daa70d61-704e-4a88-ab73-98f56391d1f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-839348841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84e416fb9684a249adb4fca64d871e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa599f35-2b", "ovs_interfaceid": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-c48bee62-45c6-40b0-9277-42ec0dc45820 req-e74b62ee-61bb-408f-818c-7e3ebd9d3ef4 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Received event network-changed-5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-c48bee62-45c6-40b0-9277-42ec0dc45820 req-e74b62ee-61bb-408f-818c-7e3ebd9d3ef4 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Refreshing instance network info cache due to event network-changed-5f088f44-a1a0-43b4-80de-4dfb8f0480ae. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c48bee62-45c6-40b0-9277-42ec0dc45820 req-e74b62ee-61bb-408f-818c-7e3ebd9d3ef4 service nova] Acquiring lock "refresh_cache-1ab6379f-1ffa-4852-a00f-b498b39a2f3d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:23 user nova-compute[75469]: INFO nova.compute.manager [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Took 10.16 seconds to spawn the instance on the hypervisor.
Nov 14 04:52:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bf06ba20-c4ea-4196-8fd8-0857583bea4e req-14af2c69-c454-4623-80df-c7d1faa73556 service nova] Releasing lock "refresh_cache-071f97b4-296b-43aa-8fa9-cf0a69c9764d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Creating config drive at /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk.config
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppxeblxmk {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppxeblxmk" returned: 0 in 0.069s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.388s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:23 user nova-compute[75469]: INFO nova.compute.manager [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Took 11.52 seconds to build instance.
Nov 14 04:52:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-dd8e365c-030c-4fbb-a26f-375bb472798f tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.843s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk 1073741824" returned: 0 in 0.076s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.488s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.212s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.network.neutron [req-1380b3d6-f08e-48a2-ab8c-864e4e8549e8 req-8466242b-7627-4438-a1a7-e4c4eff5cbf2 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Updated VIF entry in instance network info cache for port f7e4eb96-0f42-46e0-a34c-54749e5d33b9. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.network.neutron [req-1380b3d6-f08e-48a2-ab8c-864e4e8549e8 req-8466242b-7627-4438-a1a7-e4c4eff5cbf2 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Updating instance_info_cache with network_info: [{"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1380b3d6-f08e-48a2-ab8c-864e4e8549e8 req-8466242b-7627-4438-a1a7-e4c4eff5cbf2 service nova] Releasing lock "refresh_cache-ccd1b71a-7ecb-4060-bb65-e635222bfcd7" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Cannot resize image /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Ensure instance console log exists: /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Updating instance_info_cache with network_info: [{"id": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "address": "fa:16:3e:1c:55:ea", "network": {"id": "3e46277e-112a-447b-931b-653305d97318", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1114632681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc8d826c76141c092339f38b74c6f79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f088f44-a1", "ovs_interfaceid": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Releasing lock "refresh_cache-1ab6379f-1ffa-4852-a00f-b498b39a2f3d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Instance network_info: |[{"id": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "address": "fa:16:3e:1c:55:ea", "network": {"id": "3e46277e-112a-447b-931b-653305d97318", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1114632681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc8d826c76141c092339f38b74c6f79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f088f44-a1", "ovs_interfaceid": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c48bee62-45c6-40b0-9277-42ec0dc45820 req-e74b62ee-61bb-408f-818c-7e3ebd9d3ef4 service nova] Acquired lock "refresh_cache-1ab6379f-1ffa-4852-a00f-b498b39a2f3d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.network.neutron [req-c48bee62-45c6-40b0-9277-42ec0dc45820 req-e74b62ee-61bb-408f-818c-7e3ebd9d3ef4 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Refreshing network info cache for port 5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Start _get_guest_xml network_info=[{"id": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "address": "fa:16:3e:1c:55:ea", "network": {"id": "3e46277e-112a-447b-931b-653305d97318", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1114632681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc8d826c76141c092339f38b74c6f79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f088f44-a1", "ovs_interfaceid": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:52:24 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:24 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1205160601',display_name='tempest-TestVolumeSwap-server-1205160601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1205160601',id=8,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNViujSJDjP/tT6peMSsz24C2nYQ2Z7p08qPmVAAz4Y1ONWyTtsLK5IRoIWaQbvOTSzXRVQkXaKN/2caeYtJPrftygLjZG58HLKDGkrq0LdjRhgPh0+4JzxkRTYjjIerw==',key_name='tempest-keypair-439817151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dc8d826c76141c092339f38b74c6f79',ramdisk_id='',reservation_id='r-0d0t2q1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-481268122',owner_user_name='tempest-TestVolumeSwap-481268122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a159887ca76a474cad961ff2e63160de',uuid=1ab6379f-1ffa-4852-a00f-b498b39a2f3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "address": "fa:16:3e:1c:55:ea", "network": {"id": "3e46277e-112a-447b-931b-653305d97318", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1114632681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc8d826c76141c092339f38b74c6f79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f088f44-a1", "ovs_interfaceid": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Converting VIF {"id": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "address": "fa:16:3e:1c:55:ea", "network": {"id": "3e46277e-112a-447b-931b-653305d97318", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1114632681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc8d826c76141c092339f38b74c6f79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f088f44-a1", "ovs_interfaceid": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:55:ea,bridge_name='br-int',has_traffic_filtering=True,id=5f088f44-a1a0-43b4-80de-4dfb8f0480ae,network=Network(3e46277e-112a-447b-931b-653305d97318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f088f44-a1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.objects.instance [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ab6379f-1ffa-4852-a00f-b498b39a2f3d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:52:24 user nova-compute[75469]:   <uuid>1ab6379f-1ffa-4852-a00f-b498b39a2f3d</uuid>
Nov 14 04:52:24 user nova-compute[75469]:   <name>instance-00000008</name>
Nov 14 04:52:24 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:52:24 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:52:24 user nova-compute[75469]:   <metadata>
Nov 14 04:52:24 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:52:24 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:52:24 user nova-compute[75469]:       <nova:name>tempest-TestVolumeSwap-server-1205160601</nova:name>
Nov 14 04:52:24 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:52:24</nova:creationTime>
Nov 14 04:52:24 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:52:24 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:52:24 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:52:24 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:52:24 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:52:24 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:52:24 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:52:24 user nova-compute[75469]:       <nova:owner>
Nov 14 04:52:24 user nova-compute[75469]:         <nova:user uuid="a159887ca76a474cad961ff2e63160de">tempest-TestVolumeSwap-481268122-project-member</nova:user>
Nov 14 04:52:24 user nova-compute[75469]:         <nova:project uuid="5dc8d826c76141c092339f38b74c6f79">tempest-TestVolumeSwap-481268122</nova:project>
Nov 14 04:52:24 user nova-compute[75469]:       </nova:owner>
Nov 14 04:52:24 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:52:24 user nova-compute[75469]:       <nova:ports>
Nov 14 04:52:24 user nova-compute[75469]:         <nova:port uuid="5f088f44-a1a0-43b4-80de-4dfb8f0480ae">
Nov 14 04:52:24 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 04:52:24 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:24 user nova-compute[75469]:       </nova:ports>
Nov 14 04:52:24 user nova-compute[75469]:     </nova:instance>
Nov 14 04:52:24 user nova-compute[75469]:   </metadata>
Nov 14 04:52:24 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:52:24 user nova-compute[75469]:     <system>
Nov 14 04:52:24 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:52:24 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:52:24 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:52:24 user nova-compute[75469]:       <entry name="serial">1ab6379f-1ffa-4852-a00f-b498b39a2f3d</entry>
Nov 14 04:52:24 user nova-compute[75469]:       <entry name="uuid">1ab6379f-1ffa-4852-a00f-b498b39a2f3d</entry>
Nov 14 04:52:24 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:52:24 user nova-compute[75469]:     </system>
Nov 14 04:52:24 user nova-compute[75469]:   </sysinfo>
Nov 14 04:52:24 user nova-compute[75469]:   <os>
Nov 14 04:52:24 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:52:24 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:52:24 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:52:24 user nova-compute[75469]:   </os>
Nov 14 04:52:24 user nova-compute[75469]:   <features>
Nov 14 04:52:24 user nova-compute[75469]:     <acpi/>
Nov 14 04:52:24 user nova-compute[75469]:     <apic/>
Nov 14 04:52:24 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:52:24 user nova-compute[75469]:   </features>
Nov 14 04:52:24 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:52:24 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:52:24 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:52:24 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:52:24 user nova-compute[75469]:   </clock>
Nov 14 04:52:24 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:52:24 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:52:24 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:52:24 user nova-compute[75469]:   </cpu>
Nov 14 04:52:24 user nova-compute[75469]:   <devices>
Nov 14 04:52:24 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:52:24 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:52:24 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk"/>
Nov 14 04:52:24 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:52:24 user nova-compute[75469]:     </disk>
Nov 14 04:52:24 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:24 user nova-compute[75469]:       <mac address="fa:16:3e:1c:55:ea"/>
Nov 14 04:52:24 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:24 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:24 user nova-compute[75469]:       <target dev="tap5f088f44-a1"/>
Nov 14 04:52:24 user nova-compute[75469]:     </interface>
Nov 14 04:52:24 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:52:24 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/console.log" append="off"/>
Nov 14 04:52:24 user nova-compute[75469]:     </serial>
Nov 14 04:52:24 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:52:24 user nova-compute[75469]:     <video>
Nov 14 04:52:24 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:24 user nova-compute[75469]:     </video>
Nov 14 04:52:24 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:52:24 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:52:24 user nova-compute[75469]:     </rng>
Nov 14 04:52:24 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:52:24 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:52:24 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:52:24 user nova-compute[75469]:     </memballoon>
Nov 14 04:52:24 user nova-compute[75469]:   </devices>
Nov 14 04:52:24 user nova-compute[75469]: </domain>
Nov 14 04:52:24 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1205160601',display_name='tempest-TestVolumeSwap-server-1205160601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1205160601',id=8,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNViujSJDjP/tT6peMSsz24C2nYQ2Z7p08qPmVAAz4Y1ONWyTtsLK5IRoIWaQbvOTSzXRVQkXaKN/2caeYtJPrftygLjZG58HLKDGkrq0LdjRhgPh0+4JzxkRTYjjIerw==',key_name='tempest-keypair-439817151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dc8d826c76141c092339f38b74c6f79',ramdisk_id='',reservation_id='r-0d0t2q1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-481268122',owner_user_name='tempest-TestVolumeSwap-481268122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a159887ca76a474cad961ff2e63160de',uuid=1ab6379f-1ffa-4852-a00f-b498b39a2f3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "address": "fa:16:3e:1c:55:ea", "network": {"id": "3e46277e-112a-447b-931b-653305d97318", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1114632681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc8d826c76141c092339f38b74c6f79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f088f44-a1", "ovs_interfaceid": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Converting VIF {"id": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "address": "fa:16:3e:1c:55:ea", "network": {"id": "3e46277e-112a-447b-931b-653305d97318", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1114632681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc8d826c76141c092339f38b74c6f79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f088f44-a1", "ovs_interfaceid": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:55:ea,bridge_name='br-int',has_traffic_filtering=True,id=5f088f44-a1a0-43b4-80de-4dfb8f0480ae,network=Network(3e46277e-112a-447b-931b-653305d97318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f088f44-a1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG os_vif [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:55:ea,bridge_name='br-int',has_traffic_filtering=True,id=5f088f44-a1a0-43b4-80de-4dfb8f0480ae,network=Network(3e46277e-112a-447b-931b-653305d97318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f088f44-a1') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bae3342-2066-5324-8e8e-f75fb850af3b', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f088f44-a1, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f088f44-a1, col_values=(('qos', UUID('9293fc04-70d3-40c4-bd3b-cbab3f288759')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f088f44-a1, col_values=(('external_ids', {'iface-id': '5f088f44-a1a0-43b4-80de-4dfb8f0480ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:55:ea', 'vm-uuid': '1ab6379f-1ffa-4852-a00f-b498b39a2f3d'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:24 user nova-compute[75469]: INFO os_vif [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:55:ea,bridge_name='br-int',has_traffic_filtering=True,id=5f088f44-a1a0-43b4-80de-4dfb8f0480ae,network=Network(3e46277e-112a-447b-931b-653305d97318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f088f44-a1')
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] No VIF found with MAC fa:16:3e:1c:55:ea, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Acquiring lock "42daead3-8494-429a-8915-cb88ad87496a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "42daead3-8494-429a-8915-cb88ad87496a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:52:25 user nova-compute[75469]: INFO nova.compute.claims [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Claim successful on node user
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-21be38fc-3d80-45de-ae26-36b540f7c4df req-7e3cffae-3efe-4a37-a40c-58e8680d086c service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-21be38fc-3d80-45de-ae26-36b540f7c4df req-7e3cffae-3efe-4a37-a40c-58e8680d086c service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-21be38fc-3d80-45de-ae26-36b540f7c4df req-7e3cffae-3efe-4a37-a40c-58e8680d086c service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-21be38fc-3d80-45de-ae26-36b540f7c4df req-7e3cffae-3efe-4a37-a40c-58e8680d086c service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-21be38fc-3d80-45de-ae26-36b540f7c4df req-7e3cffae-3efe-4a37-a40c-58e8680d086c service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:25 user nova-compute[75469]: WARNING nova.compute.manager [req-21be38fc-3d80-45de-ae26-36b540f7c4df req-7e3cffae-3efe-4a37-a40c-58e8680d086c service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state active and task_state None.
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.network.neutron [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Successfully created port: a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.network.neutron [req-c48bee62-45c6-40b0-9277-42ec0dc45820 req-e74b62ee-61bb-408f-818c-7e3ebd9d3ef4 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Updated VIF entry in instance network info cache for port 5f088f44-a1a0-43b4-80de-4dfb8f0480ae. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.network.neutron [req-c48bee62-45c6-40b0-9277-42ec0dc45820 req-e74b62ee-61bb-408f-818c-7e3ebd9d3ef4 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Updating instance_info_cache with network_info: [{"id": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "address": "fa:16:3e:1c:55:ea", "network": {"id": "3e46277e-112a-447b-931b-653305d97318", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1114632681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc8d826c76141c092339f38b74c6f79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f088f44-a1", "ovs_interfaceid": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c48bee62-45c6-40b0-9277-42ec0dc45820 req-e74b62ee-61bb-408f-818c-7e3ebd9d3ef4 service nova] Releasing lock "refresh_cache-1ab6379f-1ffa-4852-a00f-b498b39a2f3d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:52:25 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:25 user nova-compute[75469]: DEBUG nova.policy [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72b4e5d135f549218fc26afeb51f0ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2376409c2e1f48caaf8e8c8b806a9d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:52:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Creating image(s)
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Acquiring lock "/opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "/opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "/opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:52:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Creating image(s)
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Ensure instance console log exists: /opt/stack/data/nova/instances/ccd1b71a-7ecb-4060-bb65-e635222bfcd7/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Start _get_guest_xml network_info=[{"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'dcb2dcd3-cd72-4669-bc84-be6383f47355', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtGiQqMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ccd1b71a-7ecb-4060-bb65-e635222bfcd7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6d71d08-ba53-43c2-955e-526da6f4836d', 'serial': 'b6d71d08-ba53-43c2-955e-526da6f4836d'}, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:52:26 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:26 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connector [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Factory for ISCSI on None {{(pid=75469) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtGiQqMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:52:26 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:52:26 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:52:26 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[24227745-a3f3-4528-baa4-3020d4902176]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:52:26 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a941da2-14e1-45df-946c-a4239035d39a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d] added
Nov 14 04:52:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.242s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fbc973-dbaf-4077-b523-9cd0384755c6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[230648b1-787a-4edb-ad03-2b6bb5d9fd95]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtGiQqMr {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtGiQqMr" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94861eb-537a-4daa-a596-6d861295adc6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dtGiQqMr'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc46e153-6578-4c3b-8ae9-c127494ee4d4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[af51b6e6-300e-407c-aeb5-aaf0c7c06b84]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:52:26 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:52:26 user nova-compute[75469]:  {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:52:26 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 04:52:26 user nova-compute[75469]: 
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[170a98a9-52df-43a5-a947-721368e07774]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260]
Nov 14 04:52:26 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260] successful.
Nov 14 04:52:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42a04e9-fe8c-4022-8db7-c1a2f42e3f9a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.218s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[013bd5d8-4647-4f39-8685-3666d9f78746]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk 1073741824" returned: 0 in 0.054s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6a9430-033e-4b2e-b014-2a5c7e566583]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtGiQqMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.207s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Successfully updated port: a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquired lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-916d5f69-5b54-4280-91ef-75b52f7cc57c req-ff46db76-6ef6-4f81-b5b1-ef8d6d21e657 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-changed-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-916d5f69-5b54-4280-91ef-75b52f7cc57c req-ff46db76-6ef6-4f81-b5b1-ef8d6d21e657 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Refreshing instance network info cache due to event network-changed-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-916d5f69-5b54-4280-91ef-75b52f7cc57c req-ff46db76-6ef6-4f81-b5b1-ef8d6d21e657 service nova] Acquiring lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Cannot resize image /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Ensure instance console log exists: /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Successfully created port: 679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-09fa309b-a579-4022-908e-c400a6afab9b req-2e990d2f-4940-491e-97ec-9270ac351372 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09fa309b-a579-4022-908e-c400a6afab9b req-2e990d2f-4940-491e-97ec-9270ac351372 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09fa309b-a579-4022-908e-c400a6afab9b req-2e990d2f-4940-491e-97ec-9270ac351372 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09fa309b-a579-4022-908e-c400a6afab9b req-2e990d2f-4940-491e-97ec-9270ac351372 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-09fa309b-a579-4022-908e-c400a6afab9b req-2e990d2f-4940-491e-97ec-9270ac351372 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:27 user nova-compute[75469]: WARNING nova.compute.manager [req-09fa309b-a579-4022-908e-c400a6afab9b req-2e990d2f-4940-491e-97ec-9270ac351372 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state active and task_state None.
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Updating instance_info_cache with network_info: [{"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26666613963383262', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666613963383262', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Releasing lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Instance network_info: |[{"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-916d5f69-5b54-4280-91ef-75b52f7cc57c req-ff46db76-6ef6-4f81-b5b1-ef8d6d21e657 service nova] Acquired lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-916d5f69-5b54-4280-91ef-75b52f7cc57c req-ff46db76-6ef6-4f81-b5b1-ef8d6d21e657 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Refreshing network info cache for port a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Start _get_guest_xml network_info=[{"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:52:27 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:27 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-4526189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-4526189',id=10,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO++5P4KL/ZlD2ZzykOgGS1QHT6rp4SrhnI8T9uGc2ieskb1Zpm1kRlcju/ARTYmnDKlMLY/nhtyrzPX47AoyAGkHDc3X9h1UXq82L6/7cPAy7R2c05pO9fh3r7p59j+EA==',key_name='tempest-keypair-1149227935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cab74b837d742b2bf746eaf0f8a8d5f',ramdisk_id='',reservation_id='r-r4mmdsm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1158979709',owner_user_name='tempest-TaggedAttachmentsTest-1158979709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4371d2e15d6486b8b6aafd72905b1e5',uuid=c32dcf16-daa4-4370-be69-ebeba12e2b12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converting VIF {"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:29:fb,bridge_name='br-int',has_traffic_filtering=True,id=a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f,network=Network(3bcf780a-1e9b-482a-919a-6145b57f7a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d80c3d-3d') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lazy-loading 'pci_devices' on Instance uuid c32dcf16-daa4-4370-be69-ebeba12e2b12 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1029265996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1029265996',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC0zGU7wJbLcSAC/xTktGHci7HFpvF3FBGGyk0HjgBCCZNw0EArtz9rjG5wJKkYHxC+4AB+HvLzS6vHSWBtNzcZW1BauRPxYSQ65AoHAJP9lrBL9q0UtI4jY1kwja3I9w==',key_name='tempest-keypair-896811283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb898273020b4563966aedc3204042c8',ramdisk_id='',reservation_id='r-omkk1ohs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-196671126',owner_user_name='tempest-ServerActionsV293TestJSON-196671126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='149fe6f4b2584ddb98cce41ca1f943fc',uuid=ccd1b71a-7ecb-4060-bb65-e635222bfcd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converting VIF {"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lazy-loading 'pci_devices' on Instance uuid ccd1b71a-7ecb-4060-bb65-e635222bfcd7 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:52:27 user nova-compute[75469]:   <uuid>c32dcf16-daa4-4370-be69-ebeba12e2b12</uuid>
Nov 14 04:52:27 user nova-compute[75469]:   <name>instance-0000000a</name>
Nov 14 04:52:27 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:52:27 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:52:27 user nova-compute[75469]:   <metadata>
Nov 14 04:52:27 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:52:27 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:52:27 user nova-compute[75469]:       <nova:name>tempest-device-tagging-server-4526189</nova:name>
Nov 14 04:52:27 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:52:27</nova:creationTime>
Nov 14 04:52:27 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:52:27 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:52:27 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:52:27 user nova-compute[75469]:       <nova:owner>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:user uuid="c4371d2e15d6486b8b6aafd72905b1e5">tempest-TaggedAttachmentsTest-1158979709-project-member</nova:user>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:project uuid="4cab74b837d742b2bf746eaf0f8a8d5f">tempest-TaggedAttachmentsTest-1158979709</nova:project>
Nov 14 04:52:27 user nova-compute[75469]:       </nova:owner>
Nov 14 04:52:27 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:52:27 user nova-compute[75469]:       <nova:ports>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:port uuid="a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f">
Nov 14 04:52:27 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 04:52:27 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:27 user nova-compute[75469]:       </nova:ports>
Nov 14 04:52:27 user nova-compute[75469]:     </nova:instance>
Nov 14 04:52:27 user nova-compute[75469]:   </metadata>
Nov 14 04:52:27 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:52:27 user nova-compute[75469]:     <system>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="serial">c32dcf16-daa4-4370-be69-ebeba12e2b12</entry>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="uuid">c32dcf16-daa4-4370-be69-ebeba12e2b12</entry>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:52:27 user nova-compute[75469]:     </system>
Nov 14 04:52:27 user nova-compute[75469]:   </sysinfo>
Nov 14 04:52:27 user nova-compute[75469]:   <os>
Nov 14 04:52:27 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:52:27 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:52:27 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:52:27 user nova-compute[75469]:   </os>
Nov 14 04:52:27 user nova-compute[75469]:   <features>
Nov 14 04:52:27 user nova-compute[75469]:     <acpi/>
Nov 14 04:52:27 user nova-compute[75469]:     <apic/>
Nov 14 04:52:27 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:52:27 user nova-compute[75469]:   </features>
Nov 14 04:52:27 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:52:27 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:52:27 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:52:27 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:52:27 user nova-compute[75469]:   </clock>
Nov 14 04:52:27 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:52:27 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:52:27 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:52:27 user nova-compute[75469]:   </cpu>
Nov 14 04:52:27 user nova-compute[75469]:   <devices>
Nov 14 04:52:27 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:52:27 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:52:27 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk"/>
Nov 14 04:52:27 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:52:27 user nova-compute[75469]:     </disk>
Nov 14 04:52:27 user nova-compute[75469]:     <disk type="file" device="cdrom">
Nov 14 04:52:27 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 04:52:27 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk.config"/>
Nov 14 04:52:27 user nova-compute[75469]:       <target dev="hda" bus="ide"/>
Nov 14 04:52:27 user nova-compute[75469]:     </disk>
Nov 14 04:52:27 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:27 user nova-compute[75469]:       <mac address="fa:16:3e:b1:29:fb"/>
Nov 14 04:52:27 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:27 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:27 user nova-compute[75469]:       <target dev="tapa5d80c3d-3d"/>
Nov 14 04:52:27 user nova-compute[75469]:     </interface>
Nov 14 04:52:27 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:52:27 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/console.log" append="off"/>
Nov 14 04:52:27 user nova-compute[75469]:     </serial>
Nov 14 04:52:27 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:52:27 user nova-compute[75469]:     <video>
Nov 14 04:52:27 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:27 user nova-compute[75469]:     </video>
Nov 14 04:52:27 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:52:27 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:52:27 user nova-compute[75469]:     </rng>
Nov 14 04:52:27 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:52:27 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:52:27 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:52:27 user nova-compute[75469]:     </memballoon>
Nov 14 04:52:27 user nova-compute[75469]:   </devices>
Nov 14 04:52:27 user nova-compute[75469]: </domain>
Nov 14 04:52:27 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-4526189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-4526189',id=10,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO++5P4KL/ZlD2ZzykOgGS1QHT6rp4SrhnI8T9uGc2ieskb1Zpm1kRlcju/ARTYmnDKlMLY/nhtyrzPX47AoyAGkHDc3X9h1UXq82L6/7cPAy7R2c05pO9fh3r7p59j+EA==',key_name='tempest-keypair-1149227935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cab74b837d742b2bf746eaf0f8a8d5f',ramdisk_id='',reservation_id='r-r4mmdsm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1158979709',owner_user_name='tempest-TaggedAttachmentsTest-1158979709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4371d2e15d6486b8b6aafd72905b1e5',uuid=c32dcf16-daa4-4370-be69-ebeba12e2b12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converting VIF {"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:29:fb,bridge_name='br-int',has_traffic_filtering=True,id=a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f,network=Network(3bcf780a-1e9b-482a-919a-6145b57f7a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d80c3d-3d') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG os_vif [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:29:fb,bridge_name='br-int',has_traffic_filtering=True,id=a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f,network=Network(3bcf780a-1e9b-482a-919a-6145b57f7a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d80c3d-3d') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:52:27 user nova-compute[75469]:   <uuid>ccd1b71a-7ecb-4060-bb65-e635222bfcd7</uuid>
Nov 14 04:52:27 user nova-compute[75469]:   <name>instance-00000007</name>
Nov 14 04:52:27 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:52:27 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:52:27 user nova-compute[75469]:   <metadata>
Nov 14 04:52:27 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:52:27 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:52:27 user nova-compute[75469]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1029265996</nova:name>
Nov 14 04:52:27 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:52:26</nova:creationTime>
Nov 14 04:52:27 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:52:27 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:52:27 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:52:27 user nova-compute[75469]:       <nova:owner>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:user uuid="149fe6f4b2584ddb98cce41ca1f943fc">tempest-ServerActionsV293TestJSON-196671126-project-member</nova:user>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:project uuid="bb898273020b4563966aedc3204042c8">tempest-ServerActionsV293TestJSON-196671126</nova:project>
Nov 14 04:52:27 user nova-compute[75469]:       </nova:owner>
Nov 14 04:52:27 user nova-compute[75469]:       <nova:ports>
Nov 14 04:52:27 user nova-compute[75469]:         <nova:port uuid="f7e4eb96-0f42-46e0-a34c-54749e5d33b9">
Nov 14 04:52:27 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 04:52:27 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:27 user nova-compute[75469]:       </nova:ports>
Nov 14 04:52:27 user nova-compute[75469]:     </nova:instance>
Nov 14 04:52:27 user nova-compute[75469]:   </metadata>
Nov 14 04:52:27 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:52:27 user nova-compute[75469]:     <system>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="serial">ccd1b71a-7ecb-4060-bb65-e635222bfcd7</entry>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="uuid">ccd1b71a-7ecb-4060-bb65-e635222bfcd7</entry>
Nov 14 04:52:27 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:52:27 user nova-compute[75469]:     </system>
Nov 14 04:52:27 user nova-compute[75469]:   </sysinfo>
Nov 14 04:52:27 user nova-compute[75469]:   <os>
Nov 14 04:52:27 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:52:27 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:52:27 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:52:27 user nova-compute[75469]:   </os>
Nov 14 04:52:27 user nova-compute[75469]:   <features>
Nov 14 04:52:27 user nova-compute[75469]:     <acpi/>
Nov 14 04:52:27 user nova-compute[75469]:     <apic/>
Nov 14 04:52:27 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:52:27 user nova-compute[75469]:   </features>
Nov 14 04:52:27 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:52:27 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:52:27 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:52:27 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:52:27 user nova-compute[75469]:   </clock>
Nov 14 04:52:27 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:52:27 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:52:27 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:52:27 user nova-compute[75469]:   </cpu>
Nov 14 04:52:27 user nova-compute[75469]:   <devices>
Nov 14 04:52:27 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:52:27 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:52:27 user nova-compute[75469]:       <source dev="/dev/sdb"/>
Nov 14 04:52:27 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:52:27 user nova-compute[75469]:       <serial>b6d71d08-ba53-43c2-955e-526da6f4836d</serial>
Nov 14 04:52:27 user nova-compute[75469]:     </disk>
Nov 14 04:52:27 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:27 user nova-compute[75469]:       <mac address="fa:16:3e:9f:e4:9c"/>
Nov 14 04:52:27 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:27 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:27 user nova-compute[75469]:       <target dev="tapf7e4eb96-0f"/>
Nov 14 04:52:27 user nova-compute[75469]:     </interface>
Nov 14 04:52:27 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:52:27 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/ccd1b71a-7ecb-4060-bb65-e635222bfcd7/console.log" append="off"/>
Nov 14 04:52:27 user nova-compute[75469]:     </serial>
Nov 14 04:52:27 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:52:27 user nova-compute[75469]:     <video>
Nov 14 04:52:27 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:27 user nova-compute[75469]:     </video>
Nov 14 04:52:27 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:52:27 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:52:27 user nova-compute[75469]:     </rng>
Nov 14 04:52:27 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:52:27 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:52:27 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:52:27 user nova-compute[75469]:     </memballoon>
Nov 14 04:52:27 user nova-compute[75469]:   </devices>
Nov 14 04:52:27 user nova-compute[75469]: </domain>
Nov 14 04:52:27 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1029265996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1029265996',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC0zGU7wJbLcSAC/xTktGHci7HFpvF3FBGGyk0HjgBCCZNw0EArtz9rjG5wJKkYHxC+4AB+HvLzS6vHSWBtNzcZW1BauRPxYSQ65AoHAJP9lrBL9q0UtI4jY1kwja3I9w==',key_name='tempest-keypair-896811283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb898273020b4563966aedc3204042c8',ramdisk_id='',reservation_id='r-omkk1ohs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-196671126',owner_user_name='tempest-ServerActionsV293TestJSON-196671126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='149fe6f4b2584ddb98cce41ca1f943fc',uuid=ccd1b71a-7ecb-4060-bb65-e635222bfcd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converting VIF {"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG os_vif [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16b40d48-132c-5d4b-84e2-7ae7f7b18c5b', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '974c48b7-53a3-5290-93ee-7fe530c2d746', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5d80c3d-3d, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5d80c3d-3d, col_values=(('qos', UUID('d5c793ab-843d-4a3a-b6ab-ad598e702255')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5d80c3d-3d, col_values=(('external_ids', {'iface-id': 'a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:29:fb', 'vm-uuid': 'c32dcf16-daa4-4370-be69-ebeba12e2b12'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:28 user nova-compute[75469]: INFO os_vif [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:29:fb,bridge_name='br-int',has_traffic_filtering=True,id=a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f,network=Network(3bcf780a-1e9b-482a-919a-6145b57f7a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d80c3d-3d')
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7e4eb96-0f, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7e4eb96-0f, col_values=(('qos', UUID('a2563375-5523-43cd-935a-98e2e56ac357')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7e4eb96-0f, col_values=(('external_ids', {'iface-id': 'f7e4eb96-0f42-46e0-a34c-54749e5d33b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:e4:9c', 'vm-uuid': 'ccd1b71a-7ecb-4060-bb65-e635222bfcd7'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:28 user nova-compute[75469]: INFO os_vif [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f')
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] No BDM found with device name hda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] No VIF found with MAC fa:16:3e:b1:29:fb, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:52:28 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Using config drive
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] No VIF found with MAC fa:16:3e:9f:e4:9c, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:52:28 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Creating config drive at /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk.config
Nov 14 04:52:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7ds39trl {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7ds39trl" returned: 0 in 0.069s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-916d5f69-5b54-4280-91ef-75b52f7cc57c req-ff46db76-6ef6-4f81-b5b1-ef8d6d21e657 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Updated VIF entry in instance network info cache for port a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-916d5f69-5b54-4280-91ef-75b52f7cc57c req-ff46db76-6ef6-4f81-b5b1-ef8d6d21e657 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Updating instance_info_cache with network_info: [{"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-916d5f69-5b54-4280-91ef-75b52f7cc57c req-ff46db76-6ef6-4f81-b5b1-ef8d6d21e657 service nova] Releasing lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Successfully updated port: 679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Acquiring lock "refresh_cache-42daead3-8494-429a-8915-cb88ad87496a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Acquired lock "refresh_cache-42daead3-8494-429a-8915-cb88ad87496a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.compute.manager [req-e7bc4608-3401-43c7-808a-7d004cccd676 req-0fce89e1-a732-4a12-8c0f-ffb25e325e9f service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Received event network-changed-679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG nova.compute.manager [req-e7bc4608-3401-43c7-808a-7d004cccd676 req-0fce89e1-a732-4a12-8c0f-ffb25e325e9f service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Refreshing instance network info cache due to event network-changed-679bdb9b-cea2-4445-95b1-ea3238205986. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e7bc4608-3401-43c7-808a-7d004cccd676 req-0fce89e1-a732-4a12-8c0f-ffb25e325e9f service nova] Acquiring lock "refresh_cache-42daead3-8494-429a-8915-cb88ad87496a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Updating instance_info_cache with network_info: [{"id": "679bdb9b-cea2-4445-95b1-ea3238205986", "address": "fa:16:3e:3c:20:95", "network": {"id": "36c1ae2e-640a-4264-81a8-398fc34f70d4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1580795687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2376409c2e1f48caaf8e8c8b806a9d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679bdb9b-ce", "ovs_interfaceid": "679bdb9b-cea2-4445-95b1-ea3238205986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Releasing lock "refresh_cache-42daead3-8494-429a-8915-cb88ad87496a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Instance network_info: |[{"id": "679bdb9b-cea2-4445-95b1-ea3238205986", "address": "fa:16:3e:3c:20:95", "network": {"id": "36c1ae2e-640a-4264-81a8-398fc34f70d4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1580795687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2376409c2e1f48caaf8e8c8b806a9d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679bdb9b-ce", "ovs_interfaceid": "679bdb9b-cea2-4445-95b1-ea3238205986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e7bc4608-3401-43c7-808a-7d004cccd676 req-0fce89e1-a732-4a12-8c0f-ffb25e325e9f service nova] Acquired lock "refresh_cache-42daead3-8494-429a-8915-cb88ad87496a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.network.neutron [req-e7bc4608-3401-43c7-808a-7d004cccd676 req-0fce89e1-a732-4a12-8c0f-ffb25e325e9f service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Refreshing network info cache for port 679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Start _get_guest_xml network_info=[{"id": "679bdb9b-cea2-4445-95b1-ea3238205986", "address": "fa:16:3e:3c:20:95", "network": {"id": "36c1ae2e-640a-4264-81a8-398fc34f70d4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1580795687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2376409c2e1f48caaf8e8c8b806a9d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679bdb9b-ce", "ovs_interfaceid": "679bdb9b-cea2-4445-95b1-ea3238205986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:52:29 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:29 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1946636263',display_name='tempest-VolumesAssistedSnapshotsTest-server-1946636263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1946636263',id=11,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1WYzuNiyWzFgqHkwD6n0iGngsOwh0/iiAmJwLfqOPuhfmnV19jp7xtxx1R+6WRqxp2oxLft6mx5MD2EI/z2F7QCDWPTN3ps+XcizG8xof7Ee7D6PVDzQXHOOnI4DQbOQ==',key_name='tempest-keypair-1353956079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2376409c2e1f48caaf8e8c8b806a9d87',ramdisk_id='',reservation_id='r-uu0bw7b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-142379938',owner_user_name='tempest-VolumesAssistedSnapshotsTest-142379938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b4e5d135f549218fc26afeb51f0ebe',uuid=42daead3-8494-429a-8915-cb88ad87496a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "679bdb9b-cea2-4445-95b1-ea3238205986", "address": "fa:16:3e:3c:20:95", "network": {"id": "36c1ae2e-640a-4264-81a8-398fc34f70d4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1580795687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2376409c2e1f48caaf8e8c8b806a9d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679bdb9b-ce", "ovs_interfaceid": "679bdb9b-cea2-4445-95b1-ea3238205986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Converting VIF {"id": "679bdb9b-cea2-4445-95b1-ea3238205986", "address": "fa:16:3e:3c:20:95", "network": {"id": "36c1ae2e-640a-4264-81a8-398fc34f70d4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1580795687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2376409c2e1f48caaf8e8c8b806a9d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679bdb9b-ce", "ovs_interfaceid": "679bdb9b-cea2-4445-95b1-ea3238205986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:20:95,bridge_name='br-int',has_traffic_filtering=True,id=679bdb9b-cea2-4445-95b1-ea3238205986,network=Network(36c1ae2e-640a-4264-81a8-398fc34f70d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679bdb9b-ce') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.objects.instance [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lazy-loading 'pci_devices' on Instance uuid 42daead3-8494-429a-8915-cb88ad87496a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:52:29 user nova-compute[75469]:   <uuid>42daead3-8494-429a-8915-cb88ad87496a</uuid>
Nov 14 04:52:29 user nova-compute[75469]:   <name>instance-0000000b</name>
Nov 14 04:52:29 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:52:29 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:52:29 user nova-compute[75469]:   <metadata>
Nov 14 04:52:29 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:52:29 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:52:29 user nova-compute[75469]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1946636263</nova:name>
Nov 14 04:52:29 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:52:29</nova:creationTime>
Nov 14 04:52:29 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:52:29 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:52:29 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:52:29 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:52:29 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:52:29 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:52:29 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:52:29 user nova-compute[75469]:       <nova:owner>
Nov 14 04:52:29 user nova-compute[75469]:         <nova:user uuid="72b4e5d135f549218fc26afeb51f0ebe">tempest-VolumesAssistedSnapshotsTest-142379938-project-member</nova:user>
Nov 14 04:52:29 user nova-compute[75469]:         <nova:project uuid="2376409c2e1f48caaf8e8c8b806a9d87">tempest-VolumesAssistedSnapshotsTest-142379938</nova:project>
Nov 14 04:52:29 user nova-compute[75469]:       </nova:owner>
Nov 14 04:52:29 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:52:29 user nova-compute[75469]:       <nova:ports>
Nov 14 04:52:29 user nova-compute[75469]:         <nova:port uuid="679bdb9b-cea2-4445-95b1-ea3238205986">
Nov 14 04:52:29 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 04:52:29 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:29 user nova-compute[75469]:       </nova:ports>
Nov 14 04:52:29 user nova-compute[75469]:     </nova:instance>
Nov 14 04:52:29 user nova-compute[75469]:   </metadata>
Nov 14 04:52:29 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:52:29 user nova-compute[75469]:     <system>
Nov 14 04:52:29 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:52:29 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:52:29 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:52:29 user nova-compute[75469]:       <entry name="serial">42daead3-8494-429a-8915-cb88ad87496a</entry>
Nov 14 04:52:29 user nova-compute[75469]:       <entry name="uuid">42daead3-8494-429a-8915-cb88ad87496a</entry>
Nov 14 04:52:29 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:52:29 user nova-compute[75469]:     </system>
Nov 14 04:52:29 user nova-compute[75469]:   </sysinfo>
Nov 14 04:52:29 user nova-compute[75469]:   <os>
Nov 14 04:52:29 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:52:29 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:52:29 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:52:29 user nova-compute[75469]:   </os>
Nov 14 04:52:29 user nova-compute[75469]:   <features>
Nov 14 04:52:29 user nova-compute[75469]:     <acpi/>
Nov 14 04:52:29 user nova-compute[75469]:     <apic/>
Nov 14 04:52:29 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:52:29 user nova-compute[75469]:   </features>
Nov 14 04:52:29 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:52:29 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:52:29 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:52:29 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:52:29 user nova-compute[75469]:   </clock>
Nov 14 04:52:29 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:52:29 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:52:29 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:52:29 user nova-compute[75469]:   </cpu>
Nov 14 04:52:29 user nova-compute[75469]:   <devices>
Nov 14 04:52:29 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:52:29 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:52:29 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk"/>
Nov 14 04:52:29 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:52:29 user nova-compute[75469]:     </disk>
Nov 14 04:52:29 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:29 user nova-compute[75469]:       <mac address="fa:16:3e:3c:20:95"/>
Nov 14 04:52:29 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:29 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:29 user nova-compute[75469]:       <target dev="tap679bdb9b-ce"/>
Nov 14 04:52:29 user nova-compute[75469]:     </interface>
Nov 14 04:52:29 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:52:29 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/console.log" append="off"/>
Nov 14 04:52:29 user nova-compute[75469]:     </serial>
Nov 14 04:52:29 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:52:29 user nova-compute[75469]:     <video>
Nov 14 04:52:29 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:29 user nova-compute[75469]:     </video>
Nov 14 04:52:29 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:52:29 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:52:29 user nova-compute[75469]:     </rng>
Nov 14 04:52:29 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:52:29 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:52:29 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:52:29 user nova-compute[75469]:     </memballoon>
Nov 14 04:52:29 user nova-compute[75469]:   </devices>
Nov 14 04:52:29 user nova-compute[75469]: </domain>
Nov 14 04:52:29 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1946636263',display_name='tempest-VolumesAssistedSnapshotsTest-server-1946636263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1946636263',id=11,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1WYzuNiyWzFgqHkwD6n0iGngsOwh0/iiAmJwLfqOPuhfmnV19jp7xtxx1R+6WRqxp2oxLft6mx5MD2EI/z2F7QCDWPTN3ps+XcizG8xof7Ee7D6PVDzQXHOOnI4DQbOQ==',key_name='tempest-keypair-1353956079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2376409c2e1f48caaf8e8c8b806a9d87',ramdisk_id='',reservation_id='r-uu0bw7b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-142379938',owner_user_name='tempest-VolumesAssistedSnapshotsTest-142379938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b4e5d135f549218fc26afeb51f0ebe',uuid=42daead3-8494-429a-8915-cb88ad87496a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "679bdb9b-cea2-4445-95b1-ea3238205986", "address": "fa:16:3e:3c:20:95", "network": {"id": "36c1ae2e-640a-4264-81a8-398fc34f70d4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1580795687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2376409c2e1f48caaf8e8c8b806a9d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679bdb9b-ce", "ovs_interfaceid": "679bdb9b-cea2-4445-95b1-ea3238205986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Converting VIF {"id": "679bdb9b-cea2-4445-95b1-ea3238205986", "address": "fa:16:3e:3c:20:95", "network": {"id": "36c1ae2e-640a-4264-81a8-398fc34f70d4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1580795687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2376409c2e1f48caaf8e8c8b806a9d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679bdb9b-ce", "ovs_interfaceid": "679bdb9b-cea2-4445-95b1-ea3238205986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:20:95,bridge_name='br-int',has_traffic_filtering=True,id=679bdb9b-cea2-4445-95b1-ea3238205986,network=Network(36c1ae2e-640a-4264-81a8-398fc34f70d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679bdb9b-ce') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG os_vif [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:20:95,bridge_name='br-int',has_traffic_filtering=True,id=679bdb9b-cea2-4445-95b1-ea3238205986,network=Network(36c1ae2e-640a-4264-81a8-398fc34f70d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679bdb9b-ce') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc15ffa1-2380-58cc-ab94-68e84141cac8', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap679bdb9b-ce, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap679bdb9b-ce, col_values=(('qos', UUID('e48c3505-5a36-4278-bdda-5b8f14bc106c')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap679bdb9b-ce, col_values=(('external_ids', {'iface-id': '679bdb9b-cea2-4445-95b1-ea3238205986', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:20:95', 'vm-uuid': '42daead3-8494-429a-8915-cb88ad87496a'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:29 user nova-compute[75469]: INFO os_vif [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:20:95,bridge_name='br-int',has_traffic_filtering=True,id=679bdb9b-cea2-4445-95b1-ea3238205986,network=Network(36c1ae2e-640a-4264-81a8-398fc34f70d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679bdb9b-ce')
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] No VIF found with MAC fa:16:3e:3c:20:95, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.network.neutron [req-e7bc4608-3401-43c7-808a-7d004cccd676 req-0fce89e1-a732-4a12-8c0f-ffb25e325e9f service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Updated VIF entry in instance network info cache for port 679bdb9b-cea2-4445-95b1-ea3238205986. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.network.neutron [req-e7bc4608-3401-43c7-808a-7d004cccd676 req-0fce89e1-a732-4a12-8c0f-ffb25e325e9f service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Updating instance_info_cache with network_info: [{"id": "679bdb9b-cea2-4445-95b1-ea3238205986", "address": "fa:16:3e:3c:20:95", "network": {"id": "36c1ae2e-640a-4264-81a8-398fc34f70d4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1580795687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2376409c2e1f48caaf8e8c8b806a9d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679bdb9b-ce", "ovs_interfaceid": "679bdb9b-cea2-4445-95b1-ea3238205986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e7bc4608-3401-43c7-808a-7d004cccd676 req-0fce89e1-a732-4a12-8c0f-ffb25e325e9f service nova] Releasing lock "refresh_cache-42daead3-8494-429a-8915-cb88ad87496a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:52:29 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Instance spawned successfully.
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:52:29 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Instance spawned successfully.
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:29 user nova-compute[75469]: INFO nova.compute.manager [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Took 10.60 seconds to spawn the instance on the hypervisor.
Nov 14 04:52:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:52:30 user nova-compute[75469]: INFO nova.compute.manager [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Took 12.32 seconds to spawn the instance on the hypervisor.
Nov 14 04:52:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:52:30 user nova-compute[75469]: INFO nova.compute.manager [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Took 12.07 seconds to build instance.
Nov 14 04:52:30 user nova-compute[75469]: INFO nova.compute.manager [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Took 13.54 seconds to build instance.
Nov 14 04:52:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9af68d2e-489a-47f8-893a-18069eee2c40 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.304s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2cfa022f-c008-43f2-86a6-d5d3b2b95a5c tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.832s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-2574b2c6-fcc1-4cba-a3d9-dcb8986270c4 req-8b8c2eba-517c-4d5f-94f6-f8367c75c6e1 service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Received event network-vif-plugged-f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2574b2c6-fcc1-4cba-a3d9-dcb8986270c4 req-8b8c2eba-517c-4d5f-94f6-f8367c75c6e1 service nova] Acquiring lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2574b2c6-fcc1-4cba-a3d9-dcb8986270c4 req-8b8c2eba-517c-4d5f-94f6-f8367c75c6e1 service nova] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2574b2c6-fcc1-4cba-a3d9-dcb8986270c4 req-8b8c2eba-517c-4d5f-94f6-f8367c75c6e1 service nova] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-2574b2c6-fcc1-4cba-a3d9-dcb8986270c4 req-8b8c2eba-517c-4d5f-94f6-f8367c75c6e1 service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] No waiting events found dispatching network-vif-plugged-f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:30 user nova-compute[75469]: WARNING nova.compute.manager [req-2574b2c6-fcc1-4cba-a3d9-dcb8986270c4 req-8b8c2eba-517c-4d5f-94f6-f8367c75c6e1 service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Received unexpected event network-vif-plugged-f1faa88f-6b82-4534-92f5-60e012308547 for instance with vm_state active and task_state None.
Nov 14 04:52:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Received event network-vif-plugged-f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] Acquiring lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] No waiting events found dispatching network-vif-plugged-f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:32 user nova-compute[75469]: WARNING nova.compute.manager [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Received unexpected event network-vif-plugged-f1faa88f-6b82-4534-92f5-60e012308547 for instance with vm_state active and task_state None.
Nov 14 04:52:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Received event network-vif-plugged-46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] Acquiring lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] No waiting events found dispatching network-vif-plugged-46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:32 user nova-compute[75469]: WARNING nova.compute.manager [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Received unexpected event network-vif-plugged-46427af9-a17a-49dd-9905-509577765b07 for instance with vm_state active and task_state None.
Nov 14 04:52:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Received event network-vif-plugged-46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] Acquiring lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] No waiting events found dispatching network-vif-plugged-46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:32 user nova-compute[75469]: WARNING nova.compute.manager [req-2f63751c-ec2a-43ab-81ca-85a46657a7a0 req-90043fde-b1a4-4012-ad0a-db9e8a4adfb5 service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Received unexpected event network-vif-plugged-46427af9-a17a-49dd-9905-509577765b07 for instance with vm_state active and task_state None.
Nov 14 04:52:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-4fddd64d-5e7c-4792-b998-e0f75c6b1d55 req-87c1b8cd-f5af-4a0b-b512-b143959895b7 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Received event network-vif-plugged-9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4fddd64d-5e7c-4792-b998-e0f75c6b1d55 req-87c1b8cd-f5af-4a0b-b512-b143959895b7 service nova] Acquiring lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4fddd64d-5e7c-4792-b998-e0f75c6b1d55 req-87c1b8cd-f5af-4a0b-b512-b143959895b7 service nova] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4fddd64d-5e7c-4792-b998-e0f75c6b1d55 req-87c1b8cd-f5af-4a0b-b512-b143959895b7 service nova] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-4fddd64d-5e7c-4792-b998-e0f75c6b1d55 req-87c1b8cd-f5af-4a0b-b512-b143959895b7 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] No waiting events found dispatching network-vif-plugged-9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:34 user nova-compute[75469]: WARNING nova.compute.manager [req-4fddd64d-5e7c-4792-b998-e0f75c6b1d55 req-87c1b8cd-f5af-4a0b-b512-b143959895b7 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Received unexpected event network-vif-plugged-9c3ca113-2c42-477e-9a19-7e00ef90718c for instance with vm_state active and task_state None.
Nov 14 04:52:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.compute.manager [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:52:35 user nova-compute[75469]: INFO nova.compute.claims [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Claim successful on node user
Nov 14 04:52:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:52:35 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Instance spawned successfully.
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:35 user nova-compute[75469]: INFO nova.compute.manager [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Took 9.80 seconds to spawn the instance on the hypervisor.
Nov 14 04:52:35 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:52:36 user nova-compute[75469]: INFO nova.compute.manager [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Took 20.98 seconds to build instance.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e981ed14-a30d-4d1c-98e6-234f35934f7d tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.281s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.826s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:52:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Instance spawned successfully.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:52:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:52:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Instance spawned successfully.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:52:36 user nova-compute[75469]: INFO nova.compute.manager [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Took 10.39 seconds to spawn the instance on the hypervisor.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.policy [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b98a9566c0b45d68f8d07764e61b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52720fe9997a4ae787bc1cdd8650eddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Received event network-vif-plugged-9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Acquiring lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] No waiting events found dispatching network-vif-plugged-9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:36 user nova-compute[75469]: WARNING nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Received unexpected event network-vif-plugged-9c3ca113-2c42-477e-9a19-7e00ef90718c for instance with vm_state active and task_state None.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Received event network-vif-plugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] No waiting events found dispatching network-vif-plugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:36 user nova-compute[75469]: WARNING nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Received unexpected event network-vif-plugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae for instance with vm_state active and task_state None.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Received event network-vif-plugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] No waiting events found dispatching network-vif-plugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:36 user nova-compute[75469]: WARNING nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Received unexpected event network-vif-plugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae for instance with vm_state active and task_state None.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Received event network-vif-plugged-679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Acquiring lock "42daead3-8494-429a-8915-cb88ad87496a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "42daead3-8494-429a-8915-cb88ad87496a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "42daead3-8494-429a-8915-cb88ad87496a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] No waiting events found dispatching network-vif-plugged-679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:36 user nova-compute[75469]: WARNING nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Received unexpected event network-vif-plugged-679bdb9b-cea2-4445-95b1-ea3238205986 for instance with vm_state building and task_state spawning.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Received event network-vif-plugged-679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Acquiring lock "42daead3-8494-429a-8915-cb88ad87496a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "42daead3-8494-429a-8915-cb88ad87496a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "42daead3-8494-429a-8915-cb88ad87496a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.011s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] No waiting events found dispatching network-vif-plugged-679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:36 user nova-compute[75469]: WARNING nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Received unexpected event network-vif-plugged-679bdb9b-cea2-4445-95b1-ea3238205986 for instance with vm_state building and task_state spawning.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-vif-plugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] No waiting events found dispatching network-vif-plugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:36 user nova-compute[75469]: WARNING nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received unexpected event network-vif-plugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f for instance with vm_state building and task_state spawning.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-vif-plugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] No waiting events found dispatching network-vif-plugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:36 user nova-compute[75469]: WARNING nova.compute.manager [req-95c1a996-46c8-4b98-b667-eb597cc50845 req-7520525a-82f3-435f-8b09-1572178495d8 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received unexpected event network-vif-plugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f for instance with vm_state building and task_state spawning.
Nov 14 04:52:36 user nova-compute[75469]: INFO nova.virt.block_device [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Booting with volume d2f289f6-355c-4bfb-803a-53b00ab7001a at /dev/vda
Nov 14 04:52:36 user nova-compute[75469]: INFO nova.compute.manager [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Took 13.37 seconds to spawn the instance on the hypervisor.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:52:36 user nova-compute[75469]: INFO nova.compute.manager [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Took 11.54 seconds to build instance.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2851e965-3cc2-4433-81d4-5c21f03d0a6c tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "42daead3-8494-429a-8915-cb88ad87496a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.676s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:36 user nova-compute[75469]: INFO nova.compute.manager [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Took 15.49 seconds to build instance.
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ef6d754-c311-4831-a632-2df342ab3235 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.659s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG os_brick.utils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e69d73-6ba4-406f-9544-3205df24e91f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94559e29-c385-4b6d-a99d-8189e33ad3ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[65997f85-2212-47e4-8c03-7e3a06b8b56b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea9c14b-8b8e-448a-9d10-7de905f10f55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:52:37 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:52:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc01462-f4a6-4414-be32-6b5fde90895f]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG os_brick.utils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating existing volume attachment record: 0d13ca79-2482-4b22-8c00-15f42212a03d {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully created port: 0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-51ef6949-7404-4df5-a115-5ffcafb20e67 req-62a23dca-f2ca-441c-8510-6991f610d9c1 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Received event network-vif-plugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-51ef6949-7404-4df5-a115-5ffcafb20e67 req-62a23dca-f2ca-441c-8510-6991f610d9c1 service nova] Acquiring lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-51ef6949-7404-4df5-a115-5ffcafb20e67 req-62a23dca-f2ca-441c-8510-6991f610d9c1 service nova] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-51ef6949-7404-4df5-a115-5ffcafb20e67 req-62a23dca-f2ca-441c-8510-6991f610d9c1 service nova] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-51ef6949-7404-4df5-a115-5ffcafb20e67 req-62a23dca-f2ca-441c-8510-6991f610d9c1 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] No waiting events found dispatching network-vif-plugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:37 user nova-compute[75469]: WARNING nova.compute.manager [req-51ef6949-7404-4df5-a115-5ffcafb20e67 req-62a23dca-f2ca-441c-8510-6991f610d9c1 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Received unexpected event network-vif-plugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 for instance with vm_state active and task_state None.
Nov 14 04:52:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully created port: 546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:52:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully created port: 4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully created port: 4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Received event network-vif-plugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] Acquiring lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] No waiting events found dispatching network-vif-plugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:39 user nova-compute[75469]: WARNING nova.compute.manager [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Received unexpected event network-vif-plugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 for instance with vm_state active and task_state None.
Nov 14 04:52:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] No waiting events found dispatching network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:39 user nova-compute[75469]: WARNING nova.compute.manager [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received unexpected event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 for instance with vm_state active and task_state None.
Nov 14 04:52:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] No waiting events found dispatching network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:39 user nova-compute[75469]: WARNING nova.compute.manager [req-9b72731c-c32a-4863-bf5b-b22f1d16ab69 req-bdbeb8e2-afd4-453a-a89f-020376a8c227 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received unexpected event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 for instance with vm_state active and task_state None.
Nov 14 04:52:40 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully created port: 542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:52:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:40 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully updated port: 0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-64b37683-1030-4ef1-ba24-29b796109a1d req-1f96eaa7-a733-450f-a43f-bb7f8ed62b4f service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-changed-0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-64b37683-1030-4ef1-ba24-29b796109a1d req-1f96eaa7-a733-450f-a43f-bb7f8ed62b4f service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing instance network info cache due to event network-changed-0024bc5b-8f80-467c-9e6a-a70926a62b40. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-64b37683-1030-4ef1-ba24-29b796109a1d req-1f96eaa7-a733-450f-a43f-bb7f8ed62b4f service nova] Acquiring lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-64b37683-1030-4ef1-ba24-29b796109a1d req-1f96eaa7-a733-450f-a43f-bb7f8ed62b4f service nova] Acquired lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:40 user nova-compute[75469]: DEBUG nova.network.neutron [req-64b37683-1030-4ef1-ba24-29b796109a1d req-1f96eaa7-a733-450f-a43f-bb7f8ed62b4f service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing network info cache for port 0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:41 user nova-compute[75469]: DEBUG nova.network.neutron [req-64b37683-1030-4ef1-ba24-29b796109a1d req-1f96eaa7-a733-450f-a43f-bb7f8ed62b4f service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:52:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:52:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Skipping network cache update for instance because it is Building. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 04:52:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:41 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:52:41 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 80741f98-11b9-4a80-a51b-39d5ce4e44f5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:52:41 user nova-compute[75469]: DEBUG nova.network.neutron [req-64b37683-1030-4ef1-ba24-29b796109a1d req-1f96eaa7-a733-450f-a43f-bb7f8ed62b4f service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-64b37683-1030-4ef1-ba24-29b796109a1d req-1f96eaa7-a733-450f-a43f-bb7f8ed62b4f service nova] Releasing lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updating instance_info_cache with network_info: [{"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully updated port: ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:42 user nova-compute[75469]: INFO nova.virt.block_device [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Booting with volume 4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 at /dev/vdb
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG os_brick.utils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[29361ec9-b577-49d3-8c69-91b98ced1807]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc05c67e-e516-406c-88a8-8ed1020707b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a841184-8bbc-47e4-80b5-72c7a766efa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ff8ec9-4df2-4976-bf3c-6a54b3eb1ebe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:52:42 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e014d700-ddf2-492c-a424-6e6e3e18786f]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG os_brick.utils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating existing volume attachment record: 56ce68cd-0b16-413d-871a-ee77896901ea {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-0ce29ce5-5966-4e00-98b6-0d5ebf218330 req-47a5623a-7ba4-44d8-8e76-a8633bab0918 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-changed-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-0ce29ce5-5966-4e00-98b6-0d5ebf218330 req-47a5623a-7ba4-44d8-8e76-a8633bab0918 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing instance network info cache due to event network-changed-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0ce29ce5-5966-4e00-98b6-0d5ebf218330 req-47a5623a-7ba4-44d8-8e76-a8633bab0918 service nova] Acquiring lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0ce29ce5-5966-4e00-98b6-0d5ebf218330 req-47a5623a-7ba4-44d8-8e76-a8633bab0918 service nova] Acquired lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG nova.network.neutron [req-0ce29ce5-5966-4e00-98b6-0d5ebf218330 req-47a5623a-7ba4-44d8-8e76-a8633bab0918 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing network info cache for port ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG nova.network.neutron [req-0ce29ce5-5966-4e00-98b6-0d5ebf218330 req-47a5623a-7ba4-44d8-8e76-a8633bab0918 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG nova.network.neutron [req-0ce29ce5-5966-4e00-98b6-0d5ebf218330 req-47a5623a-7ba4-44d8-8e76-a8633bab0918 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG nova.compute.manager [req-35c3bd6c-9022-4221-ac5b-ec9d9cb04cb0 req-1bde88a0-0473-4ee4-a866-579895fe8c82 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-35c3bd6c-9022-4221-ac5b-ec9d9cb04cb0 req-1bde88a0-0473-4ee4-a866-579895fe8c82 service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-35c3bd6c-9022-4221-ac5b-ec9d9cb04cb0 req-1bde88a0-0473-4ee4-a866-579895fe8c82 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-35c3bd6c-9022-4221-ac5b-ec9d9cb04cb0 req-1bde88a0-0473-4ee4-a866-579895fe8c82 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG nova.compute.manager [req-35c3bd6c-9022-4221-ac5b-ec9d9cb04cb0 req-1bde88a0-0473-4ee4-a866-579895fe8c82 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:43 user nova-compute[75469]: WARNING nova.compute.manager [req-35c3bd6c-9022-4221-ac5b-ec9d9cb04cb0 req-1bde88a0-0473-4ee4-a866-579895fe8c82 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state active and task_state None.
Nov 14 04:52:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0ce29ce5-5966-4e00-98b6-0d5ebf218330 req-47a5623a-7ba4-44d8-8e76-a8633bab0918 service nova] Releasing lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully updated port: 0f48b6b7-405e-4882-a7a7-85d3f9bbef7b {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json" returned: 0 in 0.385s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:52:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully updated port: 546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-changed-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing instance network info cache due to event network-changed-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] Acquiring lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] Acquired lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:44 user nova-compute[75469]: DEBUG nova.network.neutron [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing network info cache for port 0f48b6b7-405e-4882-a7a7-85d3f9bbef7b {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully updated port: 4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.network.neutron [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.network.neutron [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] Releasing lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-changed-546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing instance network info cache due to event network-changed-546edc2c-0c70-40e7-9423-c8d4efb3afd6. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] Acquiring lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] Acquired lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.network.neutron [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing network info cache for port 546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:45 user nova-compute[75469]: WARNING nova.compute.manager [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state active and task_state None.
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] No waiting events found dispatching network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:45 user nova-compute[75469]: WARNING nova.compute.manager [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received unexpected event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 for instance with vm_state active and task_state None.
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] No waiting events found dispatching network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:52:45 user nova-compute[75469]: WARNING nova.compute.manager [req-16270018-965c-4f24-9cbb-30b113e34e41 req-b20f8f7a-3d9f-4323-b99f-92494c21222d service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received unexpected event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 for instance with vm_state active and task_state None.
Nov 14 04:52:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG nova.network.neutron [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG nova.network.neutron [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-12879256-ad06-4218-bde0-6945ea4bafd2 req-eb7d12f6-2018-4423-9f77-df27eae07213 service nova] Releasing lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully updated port: 4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.334s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Successfully updated port: 542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-changed-4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing instance network info cache due to event network-changed-4df00d8e-ee41-4992-95f8-fa48ac62f211. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] Acquiring lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] Acquired lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG nova.network.neutron [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing network info cache for port 4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG nova.network.neutron [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG nova.network.neutron [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] Releasing lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-changed-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing instance network info cache due to event network-changed-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] Acquiring lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] Acquired lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG nova.network.neutron [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing network info cache for port 4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG nova.network.neutron [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7267MB free_disk=25.452980041503906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:48 user nova-compute[75469]: INFO nova.virt.block_device [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Booting with volume 132a3528-2b47-42b8-abb6-1885c17b7417 at /dev/vdc
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.network.neutron [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9e86828d-35d6-4c69-8e37-3db3dea8a7c9 req-c877e3cc-f704-42a6-a973-e9f9d5e936d2 service nova] Releasing lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquired lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG os_brick.utils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbdaf2f-7305-4093-85dc-a54d7db6820c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f61edf7-b963-455b-b80a-c6bcaf0284e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc88191-209f-4101-b1da-256335e9e18c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbda4f1-d29e-4a76-9501-4ff0397e3cb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:52:48 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:52:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8d171b-470f-43e7-9e59-69967f1be2a7]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG os_brick.utils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating existing volume attachment record: 84d7d319-d0bf-46ea-b124-8ffbf9b31edc {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance eb7dea82-3146-4248-bbd7-73d4d8431900 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fb551839-7b5a-4ecd-b9c0-ab53addeaa45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fbbae8e3-5d56-41ed-9be2-8856c3420f44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 0faef65d-62e0-4d48-92d5-f50395b7d190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance ccd1b71a-7ecb-4060-bb65-e635222bfcd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 1ab6379f-1ffa-4852-a00f-b498b39a2f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 071f97b4-296b-43aa-8fa9-cf0a69c9764d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c32dcf16-daa4-4370-be69-ebeba12e2b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 42daead3-8494-429a-8915-cb88ad87496a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4a3ad0cf-02b2-45af-a36e-225a14b972db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 04:52:48 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 04:52:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-a5960c97-3836-49a2-96e6-01cf21189ba6 req-45f7159f-1222-489f-83ba-9c1c6092e00b service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-changed-542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:52:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-a5960c97-3836-49a2-96e6-01cf21189ba6 req-45f7159f-1222-489f-83ba-9c1c6092e00b service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing instance network info cache due to event network-changed-542ff0c0-b25b-43f8-8348-3ae953d8bf8c. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:52:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a5960c97-3836-49a2-96e6-01cf21189ba6 req-45f7159f-1222-489f-83ba-9c1c6092e00b service nova] Acquiring lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:52:49 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:52:49 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:52:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:52:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.122s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating instance_info_cache with network_info: [{"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "address": "fa:16:3e:80:6d:38", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df00d8e-ee", "ovs_interfaceid": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Releasing lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Instance network_info: |[{"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "address": "fa:16:3e:80:6d:38", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df00d8e-ee", "ovs_interfaceid": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a5960c97-3836-49a2-96e6-01cf21189ba6 req-45f7159f-1222-489f-83ba-9c1c6092e00b service nova] Acquired lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG nova.network.neutron [req-a5960c97-3836-49a2-96e6-01cf21189ba6 req-45f7159f-1222-489f-83ba-9c1c6092e00b service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing network info cache for port 542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG nova.network.neutron [req-a5960c97-3836-49a2-96e6-01cf21189ba6 req-45f7159f-1222-489f-83ba-9c1c6092e00b service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updated VIF entry in instance network info cache for port 542ff0c0-b25b-43f8-8348-3ae953d8bf8c. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG nova.network.neutron [req-a5960c97-3836-49a2-96e6-01cf21189ba6 req-45f7159f-1222-489f-83ba-9c1c6092e00b service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating instance_info_cache with network_info: [{"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "address": "fa:16:3e:80:6d:38", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df00d8e-ee", "ovs_interfaceid": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:52:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a5960c97-3836-49a2-96e6-01cf21189ba6 req-45f7159f-1222-489f-83ba-9c1c6092e00b service nova] Releasing lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:52:53 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Creating image(s)
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Ensure instance console log exists: /opt/stack/data/nova/instances/4a3ad0cf-02b2-45af-a36e-225a14b972db/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Start _get_guest_xml network_info=[{"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "address": "fa:16:3e:80:6d:38", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df00d8e-ee", "ovs_interfaceid": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '0d13ca79-2482-4b22-8c00-15f42212a03d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYgvnNZd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a3ad0cf-02b2-45af-a36e-225a14b972db', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2f289f6-355c-4bfb-803a-53b00ab7001a', 'serial': 'd2f289f6-355c-4bfb-803a-53b00ab7001a'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'attachment_id': '56ce68cd-0b16-413d-871a-ee77896901ea', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGinBDhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a3ad0cf-02b2-45af-a36e-225a14b972db', 'attached_at': '', 'detached_at': '', 'volume_id': '4e6f32eb-833c-4a72-bea8-cbfa5ad92c31', 'serial': '4e6f32eb-833c-4a72-bea8-cbfa5ad92c31'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'attachment_id': '84d7d319-d0bf-46ea-b124-8ffbf9b31edc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjaTXBWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a3ad0cf-02b2-45af-a36e-225a14b972db', 'attached_at': '', 'detached_at': '', 'volume_id': '132a3528-2b47-42b8-abb6-1885c17b7417', 'serial': '132a3528-2b47-42b8-abb6-1885c17b7417'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:52:53 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:53 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYgvnNZd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:52:53 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:52:53 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:52:53 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3356e29-ebe7-4e9c-8529-20807b1376fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:52:53 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed60fe7-174d-4b33-ba3c-be1104c97b8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a] added
Nov 14 04:52:53 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc506c7-fb6e-4186-bfc6-457f2fda08d3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24a7821-9779-45d2-aa8b-cebf6ef43e06]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYgvnNZd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYgvnNZd" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bce7987-c94c-45da-b11c-e1ceb2b8a0cb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bYgvnNZd'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77192b89-1ded-42a6-9dbb-3105dbf3837a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af3305-6896-4857-85ec-127aba10267b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:53 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:53 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a05e98-5fea-46ad-a8cf-3befd27b8f7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a, portal: 172.16.0.220,3260]
Nov 14 04:52:53 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a, portal: 172.16.0.220,3260] successful.
Nov 14 04:52:53 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ab1ee3-32b8-4e05-ab19-5fb37f658bcb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6021a0-d5f6-43ba-9ef6-b5fb60377a9c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:53 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:52:53 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:53 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:52:53 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa1cc7b-cc1e-465f-a177-b8e46da5a8e3]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYgvnNZd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23434666230396637', 'path': '/dev/sdc'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434666230396637', 'path': '/dev/sdc'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGinBDhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:52:54 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:52:54 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:52:54 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[471932f1-8073-429a-8c5f-7a03ce051f59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:52:54 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a15f38-31db-4ba9-92f6-e9ef32de9568]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31] added
Nov 14 04:52:54 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f436a75-b98e-483d-b01e-58be0333b03b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d171d468-5229-4073-a6fe-289709f85264]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGinBDhO {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGinBDhO" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf3b23a-3c9a-4ed9-a72e-37497960787f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xGinBDhO'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1b4cbf-52d4-4e50-b6ee-dc2fe823772d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b328abc-e4fa-4384-b8fd-90463b25c2f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:54 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:52:54 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:54 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:52:54 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:52:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f03aad-f951-4435-ba8f-cf0e156b167c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31, portal: 172.16.0.220,3260]
Nov 14 04:52:55 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31, portal: 172.16.0.220,3260] successful.
Nov 14 04:52:55 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3986a7e-1923-42a9-a3f4-411e33f5761b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbddf0ae-91aa-49fe-bc10-abe69c15fea9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:55 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:52:55 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:52:55 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:55 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:52:55 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:52:55 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7a5548-a445-4fad-ba12-0d983e1abba8]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:52:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGinBDhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23730643864666335', 'path': '/dev/sdd'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730643864666335', 'path': '/dev/sdd'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjaTXBWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:52:56 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:52:56 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:52:56 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbb0e1c-045d-4327-aaa5-04138bbe9b94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:52:56 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d83a0a-06cc-441b-baf2-141d575cd2d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417] added
Nov 14 04:52:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a585f6-b2d0-4965-a826-f34d39477b7b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[03838b55-553d-43ec-8b22-498d2b31f590]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rjaTXBWe {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rjaTXBWe" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[59499f42-d7c3-4cc4-a1f2-73a1fe951a82]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rjaTXBWe'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[187be108-edd8-4ccf-904f-a0c120785825]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f44e10-bb0c-4044-a293-e9d16ffdd3b0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:56 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:52:56 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:52:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:56 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:52:56 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:52:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3672a304-0bc2-405f-b048-6d8ce59effda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417, portal: 172.16.0.220,3260]
Nov 14 04:52:56 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417, portal: 172.16.0.220,3260] successful.
Nov 14 04:52:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3da634-2b81-4ba0-a305-25d080a60f12]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f9fa54-a396-4260-b0b8-f578e5d1f03f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:56 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:52:56 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:52:56 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:52:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:52:56 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:52:56 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:52:56 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:52:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8434f9-3d8c-46fb-b157-82e12e4e2cf8]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:52:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjaTXBWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23336643735353632', 'path': '/dev/sde'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336643735353632', 'path': '/dev/sde'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:72:66,bridge_name='br-int',has_traffic_filtering=True,id=0024bc5b-8f80-467c-9e6a-a70926a62b40,network=Network(01981d52-ba0a-40a8-b8b5-7f904317bf41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0024bc5b-8f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:f7:b3,bridge_name='br-int',has_traffic_filtering=True,id=ad8ed67d-fc85-46a8-9b0c-c98f73adcf32,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad8ed67d-fc') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:87:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f48b6b7-405e-4882-a7a7-85d3f9bbef7b,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f48b6b7-40') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ee:d5,bridge_name='br-int',has_traffic_filtering=True,id=546edc2c-0c70-40e7-9423-c8d4efb3afd6,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546edc2c-0c') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "address": "fa:16:3e:80:6d:38", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df00d8e-ee", "ovs_interfaceid": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "address": "fa:16:3e:80:6d:38", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df00d8e-ee", "ovs_interfaceid": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:6d:38,bridge_name='br-int',has_traffic_filtering=True,id=4df00d8e-ee41-4992-95f8-fa48ac62f211,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df00d8e-ee') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c2:5e,bridge_name='br-int',has_traffic_filtering=True,id=4e1fdc4b-83d0-4955-bfda-5d8365ba4daf,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1fdc4b-83') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:2e:27,bridge_name='br-int',has_traffic_filtering=True,id=542ff0c0-b25b-43f8-8348-3ae953d8bf8c,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542ff0c0-b2') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.objects.instance [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a3ad0cf-02b2-45af-a36e-225a14b972db {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:52:57 user nova-compute[75469]:   <uuid>4a3ad0cf-02b2-45af-a36e-225a14b972db</uuid>
Nov 14 04:52:57 user nova-compute[75469]:   <name>instance-0000000c</name>
Nov 14 04:52:57 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:52:57 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:52:57 user nova-compute[75469]:   <metadata>
Nov 14 04:52:57 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:52:57 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:52:57 user nova-compute[75469]:       <nova:name>tempest-device-tagging-server-2144418413</nova:name>
Nov 14 04:52:57 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:52:53</nova:creationTime>
Nov 14 04:52:57 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:52:57 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:52:57 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:52:57 user nova-compute[75469]:       <nova:owner>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:user uuid="9b98a9566c0b45d68f8d07764e61b385">tempest-TaggedBootDevicesTest_v242-1425625511-project-member</nova:user>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:project uuid="52720fe9997a4ae787bc1cdd8650eddb">tempest-TaggedBootDevicesTest_v242-1425625511</nova:project>
Nov 14 04:52:57 user nova-compute[75469]:       </nova:owner>
Nov 14 04:52:57 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:52:57 user nova-compute[75469]:       <nova:ports>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:port uuid="0024bc5b-8f80-467c-9e6a-a70926a62b40">
Nov 14 04:52:57 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 04:52:57 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:port uuid="ad8ed67d-fc85-46a8-9b0c-c98f73adcf32">
Nov 14 04:52:57 user nova-compute[75469]:           <nova:ip type="fixed" address="10.1.1.185" ipVersion="4"/>
Nov 14 04:52:57 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:port uuid="0f48b6b7-405e-4882-a7a7-85d3f9bbef7b">
Nov 14 04:52:57 user nova-compute[75469]:           <nova:ip type="fixed" address="10.1.1.102" ipVersion="4"/>
Nov 14 04:52:57 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:port uuid="546edc2c-0c70-40e7-9423-c8d4efb3afd6">
Nov 14 04:52:57 user nova-compute[75469]:           <nova:ip type="fixed" address="10.1.1.125" ipVersion="4"/>
Nov 14 04:52:57 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:port uuid="4df00d8e-ee41-4992-95f8-fa48ac62f211">
Nov 14 04:52:57 user nova-compute[75469]:           <nova:ip type="fixed" address="10.1.1.80" ipVersion="4"/>
Nov 14 04:52:57 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:port uuid="4e1fdc4b-83d0-4955-bfda-5d8365ba4daf">
Nov 14 04:52:57 user nova-compute[75469]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 04:52:57 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:57 user nova-compute[75469]:         <nova:port uuid="542ff0c0-b25b-43f8-8348-3ae953d8bf8c">
Nov 14 04:52:57 user nova-compute[75469]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 04:52:57 user nova-compute[75469]:         </nova:port>
Nov 14 04:52:57 user nova-compute[75469]:       </nova:ports>
Nov 14 04:52:57 user nova-compute[75469]:     </nova:instance>
Nov 14 04:52:57 user nova-compute[75469]:   </metadata>
Nov 14 04:52:57 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:52:57 user nova-compute[75469]:     <system>
Nov 14 04:52:57 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:52:57 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:52:57 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:52:57 user nova-compute[75469]:       <entry name="serial">4a3ad0cf-02b2-45af-a36e-225a14b972db</entry>
Nov 14 04:52:57 user nova-compute[75469]:       <entry name="uuid">4a3ad0cf-02b2-45af-a36e-225a14b972db</entry>
Nov 14 04:52:57 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:52:57 user nova-compute[75469]:     </system>
Nov 14 04:52:57 user nova-compute[75469]:   </sysinfo>
Nov 14 04:52:57 user nova-compute[75469]:   <os>
Nov 14 04:52:57 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:52:57 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:52:57 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:52:57 user nova-compute[75469]:   </os>
Nov 14 04:52:57 user nova-compute[75469]:   <features>
Nov 14 04:52:57 user nova-compute[75469]:     <acpi/>
Nov 14 04:52:57 user nova-compute[75469]:     <apic/>
Nov 14 04:52:57 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:52:57 user nova-compute[75469]:   </features>
Nov 14 04:52:57 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:52:57 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:52:57 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:52:57 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:52:57 user nova-compute[75469]:   </clock>
Nov 14 04:52:57 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:52:57 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:52:57 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:52:57 user nova-compute[75469]:   </cpu>
Nov 14 04:52:57 user nova-compute[75469]:   <devices>
Nov 14 04:52:57 user nova-compute[75469]:     <disk type="file" device="cdrom">
Nov 14 04:52:57 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 04:52:57 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/4a3ad0cf-02b2-45af-a36e-225a14b972db/disk.config"/>
Nov 14 04:52:57 user nova-compute[75469]:       <target dev="hda" bus="ide"/>
Nov 14 04:52:57 user nova-compute[75469]:     </disk>
Nov 14 04:52:57 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:52:57 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:52:57 user nova-compute[75469]:       <source dev="/dev/sdc"/>
Nov 14 04:52:57 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:52:57 user nova-compute[75469]:       <serial>d2f289f6-355c-4bfb-803a-53b00ab7001a</serial>
Nov 14 04:52:57 user nova-compute[75469]:     </disk>
Nov 14 04:52:57 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:52:57 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:52:57 user nova-compute[75469]:       <source dev="/dev/sdd"/>
Nov 14 04:52:57 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 04:52:57 user nova-compute[75469]:       <serial>4e6f32eb-833c-4a72-bea8-cbfa5ad92c31</serial>
Nov 14 04:52:57 user nova-compute[75469]:     </disk>
Nov 14 04:52:57 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:52:57 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:52:57 user nova-compute[75469]:       <source dev="/dev/sde"/>
Nov 14 04:52:57 user nova-compute[75469]:       <target dev="vdc" bus="virtio"/>
Nov 14 04:52:57 user nova-compute[75469]:       <serial>132a3528-2b47-42b8-abb6-1885c17b7417</serial>
Nov 14 04:52:57 user nova-compute[75469]:     </disk>
Nov 14 04:52:57 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:57 user nova-compute[75469]:       <mac address="fa:16:3e:1b:72:66"/>
Nov 14 04:52:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:57 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:57 user nova-compute[75469]:       <target dev="tap0024bc5b-8f"/>
Nov 14 04:52:57 user nova-compute[75469]:     </interface>
Nov 14 04:52:57 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:57 user nova-compute[75469]:       <mac address="fa:16:3e:75:f7:b3"/>
Nov 14 04:52:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:57 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:57 user nova-compute[75469]:       <target dev="tapad8ed67d-fc"/>
Nov 14 04:52:57 user nova-compute[75469]:     </interface>
Nov 14 04:52:57 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:57 user nova-compute[75469]:       <mac address="fa:16:3e:0e:87:a3"/>
Nov 14 04:52:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:57 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:57 user nova-compute[75469]:       <target dev="tap0f48b6b7-40"/>
Nov 14 04:52:57 user nova-compute[75469]:     </interface>
Nov 14 04:52:57 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:57 user nova-compute[75469]:       <mac address="fa:16:3e:98:ee:d5"/>
Nov 14 04:52:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:57 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:57 user nova-compute[75469]:       <target dev="tap546edc2c-0c"/>
Nov 14 04:52:57 user nova-compute[75469]:     </interface>
Nov 14 04:52:57 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:57 user nova-compute[75469]:       <mac address="fa:16:3e:80:6d:38"/>
Nov 14 04:52:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:57 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:57 user nova-compute[75469]:       <target dev="tap4df00d8e-ee"/>
Nov 14 04:52:57 user nova-compute[75469]:     </interface>
Nov 14 04:52:57 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:57 user nova-compute[75469]:       <mac address="fa:16:3e:51:c2:5e"/>
Nov 14 04:52:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:57 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:57 user nova-compute[75469]:       <target dev="tap4e1fdc4b-83"/>
Nov 14 04:52:57 user nova-compute[75469]:     </interface>
Nov 14 04:52:57 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:52:57 user nova-compute[75469]:       <mac address="fa:16:3e:66:2e:27"/>
Nov 14 04:52:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:57 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:52:57 user nova-compute[75469]:       <target dev="tap542ff0c0-b2"/>
Nov 14 04:52:57 user nova-compute[75469]:     </interface>
Nov 14 04:52:57 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:52:57 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/4a3ad0cf-02b2-45af-a36e-225a14b972db/console.log" append="off"/>
Nov 14 04:52:57 user nova-compute[75469]:     </serial>
Nov 14 04:52:57 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:52:57 user nova-compute[75469]:     <video>
Nov 14 04:52:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:52:57 user nova-compute[75469]:     </video>
Nov 14 04:52:57 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:52:57 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:52:57 user nova-compute[75469]:     </rng>
Nov 14 04:52:57 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:52:57 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:52:57 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:52:57 user nova-compute[75469]:     </memballoon>
Nov 14 04:52:57 user nova-compute[75469]:   </devices>
Nov 14 04:52:57 user nova-compute[75469]: </domain>
Nov 14 04:52:57 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:72:66,bridge_name='br-int',has_traffic_filtering=True,id=0024bc5b-8f80-467c-9e6a-a70926a62b40,network=Network(01981d52-ba0a-40a8-b8b5-7f904317bf41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0024bc5b-8f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:72:66,bridge_name='br-int',has_traffic_filtering=True,id=0024bc5b-8f80-467c-9e6a-a70926a62b40,network=Network(01981d52-ba0a-40a8-b8b5-7f904317bf41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0024bc5b-8f') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1de3e70c-5e64-52ea-a1ab-35919c4adeaa', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0024bc5b-8f, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0024bc5b-8f, col_values=(('qos', UUID('7e59944e-7219-402a-8762-91a872b954ad')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0024bc5b-8f, col_values=(('external_ids', {'iface-id': '0024bc5b-8f80-467c-9e6a-a70926a62b40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:72:66', 'vm-uuid': '4a3ad0cf-02b2-45af-a36e-225a14b972db'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: INFO os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:72:66,bridge_name='br-int',has_traffic_filtering=True,id=0024bc5b-8f80-467c-9e6a-a70926a62b40,network=Network(01981d52-ba0a-40a8-b8b5-7f904317bf41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0024bc5b-8f')
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:f7:b3,bridge_name='br-int',has_traffic_filtering=True,id=ad8ed67d-fc85-46a8-9b0c-c98f73adcf32,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad8ed67d-fc') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:f7:b3,bridge_name='br-int',has_traffic_filtering=True,id=ad8ed67d-fc85-46a8-9b0c-c98f73adcf32,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad8ed67d-fc') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f56259bf-d87f-5797-91b5-7ce81dbc6712', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad8ed67d-fc, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad8ed67d-fc, col_values=(('qos', UUID('d4fdc5b8-fdf0-4018-8d7c-da5eefe32886')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad8ed67d-fc, col_values=(('external_ids', {'iface-id': 'ad8ed67d-fc85-46a8-9b0c-c98f73adcf32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:f7:b3', 'vm-uuid': '4a3ad0cf-02b2-45af-a36e-225a14b972db'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: INFO os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:f7:b3,bridge_name='br-int',has_traffic_filtering=True,id=ad8ed67d-fc85-46a8-9b0c-c98f73adcf32,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad8ed67d-fc')
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:87:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f48b6b7-405e-4882-a7a7-85d3f9bbef7b,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f48b6b7-40') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:87:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f48b6b7-405e-4882-a7a7-85d3f9bbef7b,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f48b6b7-40') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '561b2841-6d5d-5502-bede-4f30f6fa0bb4', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f48b6b7-40, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f48b6b7-40, col_values=(('qos', UUID('ee1426ff-e034-45ce-ad12-562e64ed4c2d')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f48b6b7-40, col_values=(('external_ids', {'iface-id': '0f48b6b7-405e-4882-a7a7-85d3f9bbef7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:87:a3', 'vm-uuid': '4a3ad0cf-02b2-45af-a36e-225a14b972db'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: INFO os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:87:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f48b6b7-405e-4882-a7a7-85d3f9bbef7b,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f48b6b7-40')
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ee:d5,bridge_name='br-int',has_traffic_filtering=True,id=546edc2c-0c70-40e7-9423-c8d4efb3afd6,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546edc2c-0c') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ee:d5,bridge_name='br-int',has_traffic_filtering=True,id=546edc2c-0c70-40e7-9423-c8d4efb3afd6,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546edc2c-0c') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37e04301-58ef-5223-8634-051a1272ce0f', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap546edc2c-0c, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap546edc2c-0c, col_values=(('qos', UUID('5c9e8781-a9e2-4a6f-9f44-93e9cf331017')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap546edc2c-0c, col_values=(('external_ids', {'iface-id': '546edc2c-0c70-40e7-9423-c8d4efb3afd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:ee:d5', 'vm-uuid': '4a3ad0cf-02b2-45af-a36e-225a14b972db'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: INFO os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ee:d5,bridge_name='br-int',has_traffic_filtering=True,id=546edc2c-0c70-40e7-9423-c8d4efb3afd6,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546edc2c-0c')
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "address": "fa:16:3e:80:6d:38", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df00d8e-ee", "ovs_interfaceid": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "address": "fa:16:3e:80:6d:38", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df00d8e-ee", "ovs_interfaceid": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:6d:38,bridge_name='br-int',has_traffic_filtering=True,id=4df00d8e-ee41-4992-95f8-fa48ac62f211,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df00d8e-ee') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:6d:38,bridge_name='br-int',has_traffic_filtering=True,id=4df00d8e-ee41-4992-95f8-fa48ac62f211,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df00d8e-ee') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74d56bdc-3994-5955-9d27-b36db69551e7', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4df00d8e-ee, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4df00d8e-ee, col_values=(('qos', UUID('ac9d987a-7e34-476c-b080-ce58a5b7ed6b')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4df00d8e-ee, col_values=(('external_ids', {'iface-id': '4df00d8e-ee41-4992-95f8-fa48ac62f211', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:6d:38', 'vm-uuid': '4a3ad0cf-02b2-45af-a36e-225a14b972db'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: INFO os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:6d:38,bridge_name='br-int',has_traffic_filtering=True,id=4df00d8e-ee41-4992-95f8-fa48ac62f211,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df00d8e-ee')
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c2:5e,bridge_name='br-int',has_traffic_filtering=True,id=4e1fdc4b-83d0-4955-bfda-5d8365ba4daf,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1fdc4b-83') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c2:5e,bridge_name='br-int',has_traffic_filtering=True,id=4e1fdc4b-83d0-4955-bfda-5d8365ba4daf,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1fdc4b-83') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '804e6c1d-1815-57a7-9f6c-6db81562d825', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e1fdc4b-83, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e1fdc4b-83, col_values=(('qos', UUID('ab6cc45a-9eb6-47c5-a68c-325520a254cc')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e1fdc4b-83, col_values=(('external_ids', {'iface-id': '4e1fdc4b-83d0-4955-bfda-5d8365ba4daf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:c2:5e', 'vm-uuid': '4a3ad0cf-02b2-45af-a36e-225a14b972db'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:58 user nova-compute[75469]: INFO os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c2:5e,bridge_name='br-int',has_traffic_filtering=True,id=4e1fdc4b-83d0-4955-bfda-5d8365ba4daf,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1fdc4b-83')
Nov 14 04:52:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:2e:27,bridge_name='br-int',has_traffic_filtering=True,id=542ff0c0-b25b-43f8-8348-3ae953d8bf8c,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542ff0c0-b2') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:2e:27,bridge_name='br-int',has_traffic_filtering=True,id=542ff0c0-b25b-43f8-8348-3ae953d8bf8c,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542ff0c0-b2') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c87135f9-ce3a-55c7-b511-ecb45439084d', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap542ff0c0-b2, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap542ff0c0-b2, col_values=(('qos', UUID('b3a6c6d4-292b-48b9-9096-5a18a03f12d0')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap542ff0c0-b2, col_values=(('external_ids', {'iface-id': '542ff0c0-b25b-43f8-8348-3ae953d8bf8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:2e:27', 'vm-uuid': '4a3ad0cf-02b2-45af-a36e-225a14b972db'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:52:58 user nova-compute[75469]: INFO os_vif [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:2e:27,bridge_name='br-int',has_traffic_filtering=True,id=542ff0c0-b25b-43f8-8348-3ae953d8bf8c,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542ff0c0-b2')
Nov 14 04:52:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] No BDM found with device name hda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] No VIF found with MAC fa:16:3e:1b:72:66, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] No VIF found with MAC fa:16:3e:80:6d:38, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:52:58 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Using config drive
Nov 14 04:52:58 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Creating config drive at /opt/stack/data/nova/instances/4a3ad0cf-02b2-45af-a36e-225a14b972db/disk.config
Nov 14 04:52:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4a3ad0cf-02b2-45af-a36e-225a14b972db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9jarp88x {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:52:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4a3ad0cf-02b2-45af-a36e-225a14b972db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9jarp88x" returned: 0 in 0.072s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG nova.compute.manager [req-4726bdc8-51f9-441a-a6ff-17dcaa79f955 req-6c0626c1-460c-44ec-be55-7c9172d6a86d service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4726bdc8-51f9-441a-a6ff-17dcaa79f955 req-6c0626c1-460c-44ec-be55-7c9172d6a86d service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4726bdc8-51f9-441a-a6ff-17dcaa79f955 req-6c0626c1-460c-44ec-be55-7c9172d6a86d service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4726bdc8-51f9-441a-a6ff-17dcaa79f955 req-6c0626c1-460c-44ec-be55-7c9172d6a86d service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG nova.compute.manager [req-4726bdc8-51f9-441a-a6ff-17dcaa79f955 req-6c0626c1-460c-44ec-be55-7c9172d6a86d service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:00 user nova-compute[75469]: WARNING nova.compute.manager [req-4726bdc8-51f9-441a-a6ff-17dcaa79f955 req-6c0626c1-460c-44ec-be55-7c9172d6a86d service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 for instance with vm_state building and task_state spawning.
Nov 14 04:53:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-91da0b6b-cb1c-4366-b659-a0a2b8d33011 req-ae02674d-c17a-4879-9e50-0bf0bc99fed3 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-91da0b6b-cb1c-4366-b659-a0a2b8d33011 req-ae02674d-c17a-4879-9e50-0bf0bc99fed3 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-91da0b6b-cb1c-4366-b659-a0a2b8d33011 req-ae02674d-c17a-4879-9e50-0bf0bc99fed3 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-91da0b6b-cb1c-4366-b659-a0a2b8d33011 req-ae02674d-c17a-4879-9e50-0bf0bc99fed3 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-91da0b6b-cb1c-4366-b659-a0a2b8d33011 req-ae02674d-c17a-4879-9e50-0bf0bc99fed3 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:01 user nova-compute[75469]: WARNING nova.compute.manager [req-91da0b6b-cb1c-4366-b659-a0a2b8d33011 req-ae02674d-c17a-4879-9e50-0bf0bc99fed3 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 for instance with vm_state building and task_state spawning.
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:02 user nova-compute[75469]: WARNING nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 for instance with vm_state building and task_state spawning.
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:02 user nova-compute[75469]: WARNING nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 for instance with vm_state building and task_state spawning.
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:02 user nova-compute[75469]: WARNING nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 for instance with vm_state building and task_state spawning.
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:02 user nova-compute[75469]: WARNING nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b for instance with vm_state building and task_state spawning.
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:02 user nova-compute[75469]: WARNING nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b for instance with vm_state building and task_state spawning.
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:02 user nova-compute[75469]: WARNING nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 for instance with vm_state building and task_state spawning.
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:02 user nova-compute[75469]: WARNING nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 for instance with vm_state building and task_state spawning.
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:02 user nova-compute[75469]: WARNING nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf for instance with vm_state building and task_state spawning.
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:02 user nova-compute[75469]: WARNING nova.compute.manager [req-dee539c0-ed1a-4d79-99b5-68f4445f8b39 req-a86c9ad0-5dad-4428-8509-8e73f165b089 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf for instance with vm_state building and task_state spawning.
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-64979e08-2c79-4cb1-a834-f8e6c6406d16 req-d59aa4c0-3af5-463a-b30c-7f1bed27ab6c service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-64979e08-2c79-4cb1-a834-f8e6c6406d16 req-d59aa4c0-3af5-463a-b30c-7f1bed27ab6c service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-64979e08-2c79-4cb1-a834-f8e6c6406d16 req-d59aa4c0-3af5-463a-b30c-7f1bed27ab6c service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-64979e08-2c79-4cb1-a834-f8e6c6406d16 req-d59aa4c0-3af5-463a-b30c-7f1bed27ab6c service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-64979e08-2c79-4cb1-a834-f8e6c6406d16 req-d59aa4c0-3af5-463a-b30c-7f1bed27ab6c service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:03 user nova-compute[75469]: WARNING nova.compute.manager [req-64979e08-2c79-4cb1-a834-f8e6c6406d16 req-d59aa4c0-3af5-463a-b30c-7f1bed27ab6c service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 for instance with vm_state building and task_state spawning.
Nov 14 04:53:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:53:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Instance spawned successfully.
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:53:04 user nova-compute[75469]: INFO nova.compute.manager [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Took 11.15 seconds to spawn the instance on the hypervisor.
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:53:04 user nova-compute[75469]: INFO nova.compute.manager [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Took 29.31 seconds to build instance.
Nov 14 04:53:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe78f5f4-fae1-4d89-830f-5e6cacd75f4c tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.434s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:04 user nova-compute[75469]: WARNING nova.compute.manager [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c for instance with vm_state active and task_state None.
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:04 user nova-compute[75469]: WARNING nova.compute.manager [req-6dd41a1e-bbb5-4266-813b-8757067f498b req-9397a82c-ced6-4908-b2a4-d66c8687901d service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c for instance with vm_state active and task_state None.
Nov 14 04:53:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:53:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:53:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:53:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:53:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:53:39 user nova-compute[75469]: INFO nova.compute.manager [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] instance snapshotting
Nov 14 04:53:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Beginning live snapshot process
Nov 14 04:53:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json -f qcow2 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json -f qcow2 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuc_wnas9/72ec785a017e4ae3aabcca449b3b2113.delta 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuc_wnas9/72ec785a017e4ae3aabcca449b3b2113.delta 1073741824" returned: 0 in 0.045s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 04:53:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75469) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 04:53:39 user nova-compute[75469]: INFO nova.virt.libvirt.host [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] UEFI support detected
Nov 14 04:53:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:53:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "eb7dea82-3146-4248-bbd7-73d4d8431900" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:53:40 user nova-compute[75469]: DEBUG nova.objects.instance [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lazy-loading 'flavor' on Instance uuid eb7dea82-3146-4248-bbd7-73d4d8431900 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:53:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "eb7dea82-3146-4248-bbd7-73d4d8431900" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:40 user nova-compute[75469]: INFO nova.compute.manager [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Attaching volume 305dd35c-97e0-4779-a606-dee0882b0261 to /dev/vdb
Nov 14 04:53:40 user nova-compute[75469]: DEBUG os_brick.utils [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e36b60-bd47-4b37-9490-073366808065]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a955d3-bc62-43e7-9c23-21496c84b300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb9f1b7-2568-4574-9b46-d9849f7d9a18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7481da-4430-461b-ac03-10036d66ade5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:53:41 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:53:41 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99d4e3b-b1ef-461f-9d9e-b76e067a1d23]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG os_brick.utils [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] <== get_connector_properties: return (200ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Updating existing volume attachment record: 47a8bd94-7d84-44d6-9967-267efe84eda6 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-eb7dea82-3146-4248-bbd7-73d4d8431900" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-eb7dea82-3146-4248-bbd7-73d4d8431900" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuc_wnas9/72ec785a017e4ae3aabcca449b3b2113.delta /opt/stack/data/nova/instances/snapshots/tmpuc_wnas9/72ec785a017e4ae3aabcca449b3b2113 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuc_wnas9/72ec785a017e4ae3aabcca449b3b2113.delta /opt/stack/data/nova/instances/snapshots/tmpuc_wnas9/72ec785a017e4ae3aabcca449b3b2113" returned: 0 in 0.441s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:41 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Snapshot extracted, beginning image upload
Nov 14 04:53:41 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Updating instance_info_cache with network_info: [{"id": "f1faa88f-6b82-4534-92f5-60e012308547", "address": "fa:16:3e:00:76:a8", "network": {"id": "bf0840e2-e4e0-4fe6-8396-777bcb4a8bba", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677352761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67dffcd3e1524676b66fbfc2833afe6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1faa88f-6b", "ovs_interfaceid": "f1faa88f-6b82-4534-92f5-60e012308547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-eb7dea82-3146-4248-bbd7-73d4d8431900" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:53:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:53:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:53:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:53:43 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:53:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:43 user nova-compute[75469]: DEBUG nova.compute.manager [req-dbfcaab8-a2d7-4454-a549-512c2aee36a4 req-7c291f03-676a-45d6-882a-2e4097ccad72 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-changed-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:43 user nova-compute[75469]: DEBUG nova.compute.manager [req-dbfcaab8-a2d7-4454-a549-512c2aee36a4 req-7c291f03-676a-45d6-882a-2e4097ccad72 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Refreshing instance network info cache due to event network-changed-5d0308df-4ec4-495c-b85e-73900b018564. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:53:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dbfcaab8-a2d7-4454-a549-512c2aee36a4 req-7c291f03-676a-45d6-882a-2e4097ccad72 service nova] Acquiring lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:53:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dbfcaab8-a2d7-4454-a549-512c2aee36a4 req-7c291f03-676a-45d6-882a-2e4097ccad72 service nova] Acquired lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:53:43 user nova-compute[75469]: DEBUG nova.network.neutron [req-dbfcaab8-a2d7-4454-a549-512c2aee36a4 req-7c291f03-676a-45d6-882a-2e4097ccad72 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Refreshing network info cache for port 5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:53:43 user nova-compute[75469]: DEBUG nova.network.neutron [req-dbfcaab8-a2d7-4454-a549-512c2aee36a4 req-7c291f03-676a-45d6-882a-2e4097ccad72 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updated VIF entry in instance network info cache for port 5d0308df-4ec4-495c-b85e-73900b018564. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:53:43 user nova-compute[75469]: DEBUG nova.network.neutron [req-dbfcaab8-a2d7-4454-a549-512c2aee36a4 req-7c291f03-676a-45d6-882a-2e4097ccad72 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updating instance_info_cache with network_info: [{"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dbfcaab8-a2d7-4454-a549-512c2aee36a4 req-7c291f03-676a-45d6-882a-2e4097ccad72 service nova] Releasing lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:53:44 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Snapshot image upload complete
Nov 14 04:53:44 user nova-compute[75469]: INFO nova.compute.manager [None req-ff79fc8d-76b9-461e-baee-b0dc939fcd06 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Took 5.17 seconds to snapshot the instance on the hypervisor.
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-84ee8741-dc44-4596-80dd-cf95a2bb745f req-07598bf6-9f33-4b72-8dd4-b495a9e75eb2 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-changed-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-84ee8741-dc44-4596-80dd-cf95a2bb745f req-07598bf6-9f33-4b72-8dd4-b495a9e75eb2 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Refreshing instance network info cache due to event network-changed-45923d58-4176-482f-b9c0-6f871c90529c. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-84ee8741-dc44-4596-80dd-cf95a2bb745f req-07598bf6-9f33-4b72-8dd4-b495a9e75eb2 service nova] Acquiring lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-84ee8741-dc44-4596-80dd-cf95a2bb745f req-07598bf6-9f33-4b72-8dd4-b495a9e75eb2 service nova] Acquired lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG nova.network.neutron [req-84ee8741-dc44-4596-80dd-cf95a2bb745f req-07598bf6-9f33-4b72-8dd4-b495a9e75eb2 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Refreshing network info cache for port 45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG nova.objects.instance [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxARMJEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:53:45 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:53:45 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:53:45 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e03741-3f78-4cec-99b1-15fc0523f531]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:53:45 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fe63d3-438d-4b46-b774-2e872a041791]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261] added
Nov 14 04:53:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f878581d-79c8-4e2a-afd4-bf7819cb94c0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb43f4a-a966-4def-8e1f-51adc2982c37]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uxARMJEO {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG nova.network.neutron [req-84ee8741-dc44-4596-80dd-cf95a2bb745f req-07598bf6-9f33-4b72-8dd4-b495a9e75eb2 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updated VIF entry in instance network info cache for port 45923d58-4176-482f-b9c0-6f871c90529c. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG nova.network.neutron [req-84ee8741-dc44-4596-80dd-cf95a2bb745f req-07598bf6-9f33-4b72-8dd4-b495a9e75eb2 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating instance_info_cache with network_info: [{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uxARMJEO" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1101d3-c73e-48b1-8b31-1df9808a4713]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uxARMJEO'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-84ee8741-dc44-4596-80dd-cf95a2bb745f req-07598bf6-9f33-4b72-8dd4-b495a9e75eb2 service nova] Releasing lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa411551-2e9c-4d41-9c88-cdaf04af2804]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0839fef-8462-4930-ba2a-9d2d4a74cb12]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:53:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:53:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a6cc85-fe51-4e30-87e4-a91678b3799f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261, portal: 172.16.0.220,3260]
Nov 14 04:53:45 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261, portal: 172.16.0.220,3260] successful.
Nov 14 04:53:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cafedc-0db0-40b6-b35f-1bb1a0188ff1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:45 user nova-compute[75469]: INFO nova.compute.manager [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Attaching volume a0c5f86b-996a-4683-90a1-2da62e9d51f4 to /dev/vdb
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9c39fb-7176-46b0-9bf2-24f9426cf8f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 (non-flash)
Nov 14 04:53:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:53:45 user nova-compute[75469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 (non-flash)
Nov 14 04:53:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a43125e-94c2-4dcd-8752-c846b277515e]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxARMJEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG os_brick.utils [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0693cd-4563-482a-aa08-79ad1825fe4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:53:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a38c72-a140-4181-a14e-cc9f2ae41efa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ee7661-42bf-457f-afaf-d1dd8fe4cbff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[be659134-453d-4e2f-bfa0-f067c345e92d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:53:46 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c701b7-b0a4-4e6d-8c0c-0efc77c839a0]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG os_brick.utils [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updating existing volume attachment record: 0db4ebb0-041f-47ef-ae4b-206bc2b2d0f4 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23839666639303232', 'path': '/dev/sdf'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839666639303232', 'path': '/dev/sdf'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:53:46 user nova-compute[75469]: DEBUG nova.objects.instance [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lazy-loading 'flavor' on Instance uuid eb7dea82-3146-4248-bbd7-73d4d8431900 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:53:47 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:53:47 user nova-compute[75469]:   <source dev="/dev/sdf"/>
Nov 14 04:53:47 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:53:47 user nova-compute[75469]:   <serial>305dd35c-97e0-4779-a606-dee0882b0261</serial>
Nov 14 04:53:47 user nova-compute[75469]: </disk>
Nov 14 04:53:47 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] No VIF found with MAC fa:16:3e:00:76:a8, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-271577f2-6bb4-41e1-823a-a61bd8714cf0 req-d0115575-0104-426a-8d11-f21399cf3ae0 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-changed-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-271577f2-6bb4-41e1-823a-a61bd8714cf0 req-d0115575-0104-426a-8d11-f21399cf3ae0 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Refreshing instance network info cache due to event network-changed-d5b49c15-8461-4b3c-aa57-0dcdd7b12305. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-271577f2-6bb4-41e1-823a-a61bd8714cf0 req-d0115575-0104-426a-8d11-f21399cf3ae0 service nova] Acquiring lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-271577f2-6bb4-41e1-823a-a61bd8714cf0 req-d0115575-0104-426a-8d11-f21399cf3ae0 service nova] Acquired lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG nova.network.neutron [req-271577f2-6bb4-41e1-823a-a61bd8714cf0 req-d0115575-0104-426a-8d11-f21399cf3ae0 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Refreshing network info cache for port d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a5bf56fe-4785-4342-b4f6-4e5f9618cc9c tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.697s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG nova.network.neutron [req-271577f2-6bb4-41e1-823a-a61bd8714cf0 req-d0115575-0104-426a-8d11-f21399cf3ae0 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updated VIF entry in instance network info cache for port d5b49c15-8461-4b3c-aa57-0dcdd7b12305. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG nova.network.neutron [req-271577f2-6bb4-41e1-823a-a61bd8714cf0 req-d0115575-0104-426a-8d11-f21399cf3ae0 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating instance_info_cache with network_info: [{"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-271577f2-6bb4-41e1-823a-a61bd8714cf0 req-d0115575-0104-426a-8d11-f21399cf3ae0 service nova] Releasing lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:53:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:53:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=6636MB free_disk=25.287673950195312GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "eb7dea82-3146-4248-bbd7-73d4d8431900" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:48 user nova-compute[75469]: INFO nova.compute.manager [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Terminating instance
Nov 14 04:53:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance eb7dea82-3146-4248-bbd7-73d4d8431900 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fb551839-7b5a-4ecd-b9c0-ab53addeaa45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fbbae8e3-5d56-41ed-9be2-8856c3420f44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 0faef65d-62e0-4d48-92d5-f50395b7d190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance ccd1b71a-7ecb-4060-bb65-e635222bfcd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 1ab6379f-1ffa-4852-a00f-b498b39a2f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 071f97b4-296b-43aa-8fa9-cf0a69c9764d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c32dcf16-daa4-4370-be69-ebeba12e2b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 42daead3-8494-429a-8915-cb88ad87496a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4a3ad0cf-02b2-45af-a36e-225a14b972db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Received event network-vif-unplugged-f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] Acquiring lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] No waiting events found dispatching network-vif-unplugged-f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Received event network-vif-unplugged-f1faa88f-6b82-4534-92f5-60e012308547 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Received event network-vif-plugged-f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] Acquiring lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] No waiting events found dispatching network-vif-plugged-f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:49 user nova-compute[75469]: WARNING nova.compute.manager [req-0081071b-9ca3-4320-b41d-2f0bbea94fa6 req-3a4ecc32-cb4e-44a8-97ef-285e84a02e9e service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Received unexpected event network-vif-plugged-f1faa88f-6b82-4534-92f5-60e012308547 for instance with vm_state active and task_state deleting.
Nov 14 04:53:49 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Instance destroyed successfully.
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lazy-loading 'resources' on Instance uuid eb7dea82-3146-4248-bbd7-73d4d8431900 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1951733129',display_name='tempest-DeleteServersTestJSON-server-1951733129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1951733129',id=2,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67dffcd3e1524676b66fbfc2833afe6c',ramdisk_id='',reservation_id='r-ojo8o53k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-914079182',owner_user_name='tempest-DeleteServersTestJSON-914079182-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:52:05Z,user_data=None,user_id='cf6681ae7c2d427ba0c5fe6cd0079b92',uuid=eb7dea82-3146-4248-bbd7-73d4d8431900,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1faa88f-6b82-4534-92f5-60e012308547", "address": "fa:16:3e:00:76:a8", "network": {"id": "bf0840e2-e4e0-4fe6-8396-777bcb4a8bba", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677352761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67dffcd3e1524676b66fbfc2833afe6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1faa88f-6b", "ovs_interfaceid": "f1faa88f-6b82-4534-92f5-60e012308547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Converting VIF {"id": "f1faa88f-6b82-4534-92f5-60e012308547", "address": "fa:16:3e:00:76:a8", "network": {"id": "bf0840e2-e4e0-4fe6-8396-777bcb4a8bba", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677352761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67dffcd3e1524676b66fbfc2833afe6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1faa88f-6b", "ovs_interfaceid": "f1faa88f-6b82-4534-92f5-60e012308547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=f1faa88f-6b82-4534-92f5-60e012308547,network=Network(bf0840e2-e4e0-4fe6-8396-777bcb4a8bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1faa88f-6b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_vif [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=f1faa88f-6b82-4534-92f5-60e012308547,network=Network(bf0840e2-e4e0-4fe6-8396-777bcb4a8bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1faa88f-6b') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1faa88f-6b, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77e1c576-9502-4379-9e85-63361ca38f05) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:49 user nova-compute[75469]: INFO os_vif [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=f1faa88f-6b82-4534-92f5-60e012308547,network=Network(bf0840e2-e4e0-4fe6-8396-777bcb4a8bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1faa88f-6b')
Nov 14 04:53:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxARMJEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:53:49 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfe0a00-de00-4ee6-82a5-f67e54422475]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:53:49 user nova-compute[75469]: No targets found.
Nov 14 04:53:49 user nova-compute[75469]: iSNS:
Nov 14 04:53:49 user nova-compute[75469]: No targets found.
Nov 14 04:53:49 user nova-compute[75469]: STATIC:
Nov 14 04:53:49 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a
Nov 14 04:53:49 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:53:49 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:53:49 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:53:49 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:53:49 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:53:49 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261
Nov 14 04:53:49 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:53:49 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:53:49 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31
Nov 14 04:53:49 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:53:49 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:53:49 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417
Nov 14 04:53:49 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:53:49 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:53:49 user nova-compute[75469]: FIRMWARE:
Nov 14 04:53:49 user nova-compute[75469]: No targets found.
Nov 14 04:53:49 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:53:49 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:53:49 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea6cca4-0481-4f6b-95ac-db53085d6322]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f50c98-61b4-409a-a33a-a766b984904a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:53:49 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:53:49 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:53:49 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:53:49 user nova-compute[75469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 (non-flash)
Nov 14 04:53:49 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:53:49 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:53:49 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:53:49 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:53:49 user nova-compute[75469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 (non-flash)
Nov 14 04:53:49 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa758fde8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261'): ({'sdf'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Removing single pathed devices sdf {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d428bc2d-0019-42f1-a1cf-2febf508399f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab00681f-72f9-4d07-aea8-29762e2c401a]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Flushing IO for device /dev/sdf {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01fd2d6-9759-48d5-8e1f-a0036b77c59f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:53:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd14441d-45ce-474c-b635-c5a575c8bcb6]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] SCSI volumes sdf have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ccc8ef-437d-4ab2-87d2-99e9766d06d6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[730c1955-edea-43c6-8fee-283a52eec852]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261, portal: 172.16.0.220,3260]
Nov 14 04:53:50 user nova-compute[75469]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261, portal: 172.16.0.220,3260] successful.
Nov 14 04:53:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305dd35c-97e0-4779-a606-dee0882b0261 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[09082f5e-1d93-4dd2-ab85-2c23019be0a2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] <== disconnect_volume: return (330ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:53:50 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Deleting instance files /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900_del
Nov 14 04:53:50 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Deletion of /opt/stack/data/nova/instances/eb7dea82-3146-4248-bbd7-73d4d8431900_del complete
Nov 14 04:53:50 user nova-compute[75469]: INFO nova.compute.manager [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:50 user nova-compute[75469]: INFO nova.compute.manager [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Shelving
Nov 14 04:53:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIhwqitL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:53:50 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:53:50 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:53:50 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beb8037-888d-4668-a55a-c9a11c830b85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:53:50 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac731052-6f7f-405b-afc5-c9eaf008866a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4] added
Nov 14 04:53:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[195139e7-8db6-444a-abed-eef7ead66a31]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb7404e-d74f-4b0a-862c-81618077bbf5]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIhwqitL {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIhwqitL" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0675aef-8a71-4e0b-a3f9-bd33eb27d398]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CIhwqitL'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b48e156-2ee9-4dcf-9876-a2fe2822e4b7]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3401cae-7ff9-45d4-ba4e-6a137c501c0a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:53:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:53:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad71831-48d8-41eb-b4a0-76962853de2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260]
Nov 14 04:53:50 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260] successful.
Nov 14 04:53:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b0b0a4-4024-4e9b-be1e-a9037929a2bd]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[78811ad7-c44e-4e1e-a333-a8534f926eb0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:53:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:53:50 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:53:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff63258f-1a92-4fe0-86e1-f6080e945cc8]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIhwqitL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG nova.compute.manager [req-a8a60d6e-6f4a-4bbf-a0bb-431f80c68284 req-68c4507c-7c1d-4fcf-af30-1d503a5bf087 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-vif-unplugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8a60d6e-6f4a-4bbf-a0bb-431f80c68284 req-68c4507c-7c1d-4fcf-af30-1d503a5bf087 service nova] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8a60d6e-6f4a-4bbf-a0bb-431f80c68284 req-68c4507c-7c1d-4fcf-af30-1d503a5bf087 service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8a60d6e-6f4a-4bbf-a0bb-431f80c68284 req-68c4507c-7c1d-4fcf-af30-1d503a5bf087 service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:50 user nova-compute[75469]: DEBUG nova.compute.manager [req-a8a60d6e-6f4a-4bbf-a0bb-431f80c68284 req-68c4507c-7c1d-4fcf-af30-1d503a5bf087 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] No waiting events found dispatching network-vif-unplugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:50 user nova-compute[75469]: WARNING nova.compute.manager [req-a8a60d6e-6f4a-4bbf-a0bb-431f80c68284 req-68c4507c-7c1d-4fcf-af30-1d503a5bf087 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received unexpected event network-vif-unplugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 for instance with vm_state active and task_state shelving.
Nov 14 04:53:51 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:53:51 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Took 0.95 seconds to deallocate network for instance.
Nov 14 04:53:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-a3911905-b91e-44c0-aed1-04cd0a59a63f req-0c184791-7b10-4743-abdf-1bb0d2b1c9cb service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Received event network-vif-deleted-f1faa88f-6b82-4534-92f5-60e012308547 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:51 user nova-compute[75469]: INFO nova.compute.manager [req-a3911905-b91e-44c0-aed1-04cd0a59a63f req-0c184791-7b10-4743-abdf-1bb0d2b1c9cb service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Neutron deleted interface f1faa88f-6b82-4534-92f5-60e012308547; detaching it from the instance and deleting it from the info cache
Nov 14 04:53:51 user nova-compute[75469]: DEBUG nova.network.neutron [req-a3911905-b91e-44c0-aed1-04cd0a59a63f req-0c184791-7b10-4743-abdf-1bb0d2b1c9cb service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:53:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-a3911905-b91e-44c0-aed1-04cd0a59a63f req-0c184791-7b10-4743-abdf-1bb0d2b1c9cb service nova] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Detach interface failed, port_id=f1faa88f-6b82-4534-92f5-60e012308547, reason: Instance eb7dea82-3146-4248-bbd7-73d4d8431900 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 04:53:51 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Instance destroyed successfully.
Nov 14 04:53:51 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Beginning cold snapshot process
Nov 14 04:53:51 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 04:53:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk /opt/stack/data/nova/instances/snapshots/tmplumm0mfk/410203392559469abb4d7d0c1ba07611 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:53:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:53:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23762303430633430', 'path': '/dev/sdf'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:53:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762303430633430', 'path': '/dev/sdf'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:53:51 user nova-compute[75469]: DEBUG nova.objects.instance [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:53:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:53:51 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:53:51 user nova-compute[75469]:   <source dev="/dev/sdf"/>
Nov 14 04:53:51 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:53:51 user nova-compute[75469]:   <serial>a0c5f86b-996a-4683-90a1-2da62e9d51f4</serial>
Nov 14 04:53:51 user nova-compute[75469]: </disk>
Nov 14 04:53:51 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:53:51 user nova-compute[75469]: INFO nova.compute.manager [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] [instance: eb7dea82-3146-4248-bbd7-73d4d8431900] Took 0.76 seconds to detach 1 volumes for instance.
Nov 14 04:53:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk /opt/stack/data/nova/instances/snapshots/tmplumm0mfk/410203392559469abb4d7d0c1ba07611" returned: 0 in 0.493s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:53:52 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Snapshot extracted, beginning image upload
Nov 14 04:53:52 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No VIF found with MAC fa:16:3e:de:a7:a6, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:52 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Deleted allocations for instance eb7dea82-3146-4248-bbd7-73d4d8431900
Nov 14 04:53:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7145f486-b00a-425b-9650-ea7f7a403eff tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.567s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8241466c-ced1-4b28-b3ef-c170c2453e75 tempest-DeleteServersTestJSON-914079182 tempest-DeleteServersTestJSON-914079182-project-member] Lock "eb7dea82-3146-4248-bbd7-73d4d8431900" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.548s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-e1ebecd3-52df-449e-a7fd-c850a3dd7651 req-20e9e8d2-aac4-43a9-b747-19727568df68 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e1ebecd3-52df-449e-a7fd-c850a3dd7651 req-20e9e8d2-aac4-43a9-b747-19727568df68 service nova] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e1ebecd3-52df-449e-a7fd-c850a3dd7651 req-20e9e8d2-aac4-43a9-b747-19727568df68 service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e1ebecd3-52df-449e-a7fd-c850a3dd7651 req-20e9e8d2-aac4-43a9-b747-19727568df68 service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-e1ebecd3-52df-449e-a7fd-c850a3dd7651 req-20e9e8d2-aac4-43a9-b747-19727568df68 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] No waiting events found dispatching network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:52 user nova-compute[75469]: WARNING nova.compute.manager [req-e1ebecd3-52df-449e-a7fd-c850a3dd7651 req-20e9e8d2-aac4-43a9-b747-19727568df68 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received unexpected event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 04:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-418d5053-fba6-4c39-94e7-7bcaf9939508 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-418d5053-fba6-4c39-94e7-7bcaf9939508 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-418d5053-fba6-4c39-94e7-7bcaf9939508 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:53:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-418d5053-fba6-4c39-94e7-7bcaf9939508 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75469) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 04:53:53 user nova-compute[75469]: DEBUG nova.objects.instance [None req-418d5053-fba6-4c39-94e7-7bcaf9939508 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:53:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance destroyed successfully.
Nov 14 04:53:54 user nova-compute[75469]: DEBUG nova.compute.manager [None req-418d5053-fba6-4c39-94e7-7bcaf9939508 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-418d5053-fba6-4c39-94e7-7bcaf9939508 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.854s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Snapshot image upload complete
Nov 14 04:53:54 user nova-compute[75469]: DEBUG nova.compute.manager [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:53:54 user nova-compute[75469]: INFO nova.compute.manager [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Shelve offloading
Nov 14 04:53:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Instance destroyed successfully.
Nov 14 04:53:54 user nova-compute[75469]: DEBUG nova.compute.manager [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquired lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG nova.network.neutron [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:54 user nova-compute[75469]: WARNING nova.compute.manager [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state stopped and task_state None.
Nov 14 04:53:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:53:55 user nova-compute[75469]: WARNING nova.compute.manager [req-09b3aed6-6d68-4c3d-b714-ce36cbfff201 req-d412517b-6023-46ce-9251-6504839abc2c service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state stopped and task_state None.
Nov 14 04:53:55 user nova-compute[75469]: DEBUG nova.network.neutron [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating instance_info_cache with network_info: [{"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Releasing lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:53:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Instance destroyed successfully.
Nov 14 04:53:55 user nova-compute[75469]: DEBUG nova.objects.instance [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'resources' on Instance uuid fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-864532062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-864532062',id=5,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJxiXPqJ+9+ZxyO6Uypnua2AMVUYfA5aTo9i6T6J9NsbMbvS1ODQw3d9jf076JfAUED2qfOIr52fC3va9mIfCd/X6AwXEVw/N/gscS3X8nizJZYWlkeEX3UqEz1ZSu22g==',key_name='tempest-keypair-1957997782',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-458dg48g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member',shelved_at='2023-11-14T04:53:54.474511',shelved_host='user',shelved_image_id='69b045f1-b132-426c-86e4-61ee055c69e2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:53:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=fbbae8e3-5d56-41ed-9be2-8856c3420f44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG os_vif [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5b49c15-84, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-b01bb1ff-cc24-4205-8d4d-d9e82b4f9b62 req-133105ac-e5a0-41ad-8515-7e102b9a177c service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-changed-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-b01bb1ff-cc24-4205-8d4d-d9e82b4f9b62 req-133105ac-e5a0-41ad-8515-7e102b9a177c service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Refreshing instance network info cache due to event network-changed-d5b49c15-8461-4b3c-aa57-0dcdd7b12305. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b01bb1ff-cc24-4205-8d4d-d9e82b4f9b62 req-133105ac-e5a0-41ad-8515-7e102b9a177c service nova] Acquiring lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b01bb1ff-cc24-4205-8d4d-d9e82b4f9b62 req-133105ac-e5a0-41ad-8515-7e102b9a177c service nova] Acquired lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG nova.network.neutron [req-b01bb1ff-cc24-4205-8d4d-d9e82b4f9b62 req-133105ac-e5a0-41ad-8515-7e102b9a177c service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Refreshing network info cache for port d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96e22a3e-a3c7-4c74-a7ba-8c02d34df896) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:55 user nova-compute[75469]: INFO os_vif [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84')
Nov 14 04:53:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Deleting instance files /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44_del
Nov 14 04:53:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Deletion of /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44_del complete
Nov 14 04:53:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:53:55 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Deleted allocations for instance fbbae8e3-5d56-41ed-9be2-8856c3420f44
Nov 14 04:53:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG nova.objects.instance [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'numa_topology' on Instance uuid fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:53:55 user nova-compute[75469]: DEBUG nova.objects.base [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Object Instance<fbbae8e3-5d56-41ed-9be2-8856c3420f44> lazy-loaded attributes: resources,numa_topology {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:53:56 user nova-compute[75469]: DEBUG nova.network.neutron [req-b01bb1ff-cc24-4205-8d4d-d9e82b4f9b62 req-133105ac-e5a0-41ad-8515-7e102b9a177c service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updated VIF entry in instance network info cache for port d5b49c15-8461-4b3c-aa57-0dcdd7b12305. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:53:56 user nova-compute[75469]: DEBUG nova.network.neutron [req-b01bb1ff-cc24-4205-8d4d-d9e82b4f9b62 req-133105ac-e5a0-41ad-8515-7e102b9a177c service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating instance_info_cache with network_info: [{"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd5b49c15-84", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:53:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b01bb1ff-cc24-4205-8d4d-d9e82b4f9b62 req-133105ac-e5a0-41ad-8515-7e102b9a177c service nova] Releasing lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:53:56 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:53:56 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:53:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:53:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-83298054-5c57-4acd-b7dd-efcbd898c1c8 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.716s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-0ac21ee1-2d13-488e-b9d8-3af85ea48ac3 req-b5d5b0ac-5bfa-432b-b6c4-8c85cc228235 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Received event network-changed-9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-0ac21ee1-2d13-488e-b9d8-3af85ea48ac3 req-b5d5b0ac-5bfa-432b-b6c4-8c85cc228235 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Refreshing instance network info cache due to event network-changed-9c3ca113-2c42-477e-9a19-7e00ef90718c. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:54:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0ac21ee1-2d13-488e-b9d8-3af85ea48ac3 req-b5d5b0ac-5bfa-432b-b6c4-8c85cc228235 service nova] Acquiring lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0ac21ee1-2d13-488e-b9d8-3af85ea48ac3 req-b5d5b0ac-5bfa-432b-b6c4-8c85cc228235 service nova] Acquired lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:02 user nova-compute[75469]: DEBUG nova.network.neutron [req-0ac21ee1-2d13-488e-b9d8-3af85ea48ac3 req-b5d5b0ac-5bfa-432b-b6c4-8c85cc228235 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Refreshing network info cache for port 9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:54:03 user nova-compute[75469]: DEBUG nova.network.neutron [req-0ac21ee1-2d13-488e-b9d8-3af85ea48ac3 req-b5d5b0ac-5bfa-432b-b6c4-8c85cc228235 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Updated VIF entry in instance network info cache for port 9c3ca113-2c42-477e-9a19-7e00ef90718c. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:54:03 user nova-compute[75469]: DEBUG nova.network.neutron [req-0ac21ee1-2d13-488e-b9d8-3af85ea48ac3 req-b5d5b0ac-5bfa-432b-b6c4-8c85cc228235 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Updating instance_info_cache with network_info: [{"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0ac21ee1-2d13-488e-b9d8-3af85ea48ac3 req-b5d5b0ac-5bfa-432b-b6c4-8c85cc228235 service nova] Releasing lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "0faef65d-62e0-4d48-92d5-f50395b7d190" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lazy-loading 'flavor' on Instance uuid 0faef65d-62e0-4d48-92d5-f50395b7d190 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "0faef65d-62e0-4d48-92d5-f50395b7d190" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:04 user nova-compute[75469]: INFO nova.compute.manager [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Attaching volume 89680ce7-14a8-4fb8-a9ee-993031641201 to /dev/vdb
Nov 14 04:54:04 user nova-compute[75469]: DEBUG os_brick.utils [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc9705f-cfe4-4b4c-82ed-748ec945527d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d001c63-6dc3-4c3d-ade9-9c60addfc0d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[741d4ef1-05b6-42a4-9a8e-6e52772066bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca81dc7a-78fb-4e85-b465-5e5140488af6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:04 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:54:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fcd2ff-7fba-4d86-840c-66649d94cee2]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG os_brick.utils [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:04 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Updating existing volume attachment record: ce9112b0-d61b-424a-9935-161efbd8b711 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:54:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-852a9589-b23a-4eea-955a-d57f667390d6 req-a569349c-002f-41c1-a2ac-d62d1acc12ce service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-changed-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-852a9589-b23a-4eea-955a-d57f667390d6 req-a569349c-002f-41c1-a2ac-d62d1acc12ce service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Refreshing instance network info cache due to event network-changed-f7e4eb96-0f42-46e0-a34c-54749e5d33b9. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:54:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-852a9589-b23a-4eea-955a-d57f667390d6 req-a569349c-002f-41c1-a2ac-d62d1acc12ce service nova] Acquiring lock "refresh_cache-ccd1b71a-7ecb-4060-bb65-e635222bfcd7" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-852a9589-b23a-4eea-955a-d57f667390d6 req-a569349c-002f-41c1-a2ac-d62d1acc12ce service nova] Acquired lock "refresh_cache-ccd1b71a-7ecb-4060-bb65-e635222bfcd7" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:05 user nova-compute[75469]: DEBUG nova.network.neutron [req-852a9589-b23a-4eea-955a-d57f667390d6 req-a569349c-002f-41c1-a2ac-d62d1acc12ce service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Refreshing network info cache for port f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:54:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:06 user nova-compute[75469]: DEBUG nova.network.neutron [req-852a9589-b23a-4eea-955a-d57f667390d6 req-a569349c-002f-41c1-a2ac-d62d1acc12ce service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Updated VIF entry in instance network info cache for port f7e4eb96-0f42-46e0-a34c-54749e5d33b9. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:54:06 user nova-compute[75469]: DEBUG nova.network.neutron [req-852a9589-b23a-4eea-955a-d57f667390d6 req-a569349c-002f-41c1-a2ac-d62d1acc12ce service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Updating instance_info_cache with network_info: [{"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-852a9589-b23a-4eea-955a-d57f667390d6 req-a569349c-002f-41c1-a2ac-d62d1acc12ce service nova] Releasing lock "refresh_cache-ccd1b71a-7ecb-4060-bb65-e635222bfcd7" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:06 user nova-compute[75469]: INFO nova.compute.manager [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Rebuilding instance
Nov 14 04:54:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:54:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG nova.objects.instance [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lazy-loading 'flavor' on Instance uuid 1ab6379f-1ffa-4852-a00f-b498b39a2f3d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-c95dec9b-58ae-45e9-a556-1ede626fa6aa req-ab42018b-2615-4f58-b82e-7b1dc793fa5b service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-vif-unplugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c95dec9b-58ae-45e9-a556-1ede626fa6aa req-ab42018b-2615-4f58-b82e-7b1dc793fa5b service nova] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c95dec9b-58ae-45e9-a556-1ede626fa6aa req-ab42018b-2615-4f58-b82e-7b1dc793fa5b service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c95dec9b-58ae-45e9-a556-1ede626fa6aa req-ab42018b-2615-4f58-b82e-7b1dc793fa5b service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-c95dec9b-58ae-45e9-a556-1ede626fa6aa req-ab42018b-2615-4f58-b82e-7b1dc793fa5b service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] No waiting events found dispatching network-vif-unplugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:07 user nova-compute[75469]: WARNING nova.compute.manager [req-c95dec9b-58ae-45e9-a556-1ede626fa6aa req-ab42018b-2615-4f58-b82e-7b1dc793fa5b service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received unexpected event network-vif-unplugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 for instance with vm_state active and task_state rebuilding.
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:07 user nova-compute[75469]: INFO nova.compute.manager [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Attaching volume 7579bc3a-c6b8-47b6-a373-20c04568e4b6 to /dev/vdb
Nov 14 04:54:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-e4fb7720-7232-4f98-9ac2-cb9bf1706ce0 req-e1f6ce30-f645-4d3a-a734-cefdaf3a8212 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Received event network-changed-5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-e4fb7720-7232-4f98-9ac2-cb9bf1706ce0 req-e1f6ce30-f645-4d3a-a734-cefdaf3a8212 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Refreshing instance network info cache due to event network-changed-5f088f44-a1a0-43b4-80de-4dfb8f0480ae. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e4fb7720-7232-4f98-9ac2-cb9bf1706ce0 req-e1f6ce30-f645-4d3a-a734-cefdaf3a8212 service nova] Acquiring lock "refresh_cache-1ab6379f-1ffa-4852-a00f-b498b39a2f3d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e4fb7720-7232-4f98-9ac2-cb9bf1706ce0 req-e1f6ce30-f645-4d3a-a734-cefdaf3a8212 service nova] Acquired lock "refresh_cache-1ab6379f-1ffa-4852-a00f-b498b39a2f3d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG nova.network.neutron [req-e4fb7720-7232-4f98-9ac2-cb9bf1706ce0 req-e1f6ce30-f645-4d3a-a734-cefdaf3a8212 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Refreshing network info cache for port 5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.utils [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ad3d91-877a-4676-98e8-7c591dd332f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[600f835f-2792-47f1-98fe-63bce91a7cb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77882107-71cc-4506-9242-d1a667540e11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[151bed91-eaf3-4579-bf93-753f2ce225c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:07 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2171d81a-9a64-451c-be6f-ea356da6f1a7]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.utils [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Updating existing volume attachment record: 1818701a-eb6a-4de9-bb6b-ad57b1d0a17c {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:07 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Instance destroyed successfully.
Nov 14 04:54:07 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Instance destroyed successfully.
Nov 14 04:54:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-331822876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1029265996',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC0zGU7wJbLcSAC/xTktGHci7HFpvF3FBGGyk0HjgBCCZNw0EArtz9rjG5wJKkYHxC+4AB+HvLzS6vHSWBtNzcZW1BauRPxYSQ65AoHAJP9lrBL9q0UtI4jY1kwja3I9w==',key_name='tempest-keypair-896811283',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb898273020b4563966aedc3204042c8',ramdisk_id='',reservation_id='r-omkk1ohs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-196671126',owner_user_name='tempest-ServerActionsV293TestJSON-196671126-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='149fe6f4b2584ddb98cce41ca1f943fc',uuid=ccd1b71a-7ecb-4060-bb65-e635222bfcd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converting VIF {"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_vif [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7e4eb96-0f, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2563375-5523-43cd-935a-98e2e56ac357) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:07 user nova-compute[75469]: INFO os_vif [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f')
Nov 14 04:54:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtGiQqMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:07 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a2895a-eadb-4760-8ec9-5c4ca7742587]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:54:07 user nova-compute[75469]: No targets found.
Nov 14 04:54:07 user nova-compute[75469]: iSNS:
Nov 14 04:54:07 user nova-compute[75469]: No targets found.
Nov 14 04:54:07 user nova-compute[75469]: STATIC:
Nov 14 04:54:07 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a
Nov 14 04:54:07 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:07 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:07 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:54:07 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:07 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:07 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31
Nov 14 04:54:07 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:07 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:07 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:54:07 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:07 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:07 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417
Nov 14 04:54:07 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:07 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:07 user nova-compute[75469]: FIRMWARE:
Nov 14 04:54:07 user nova-compute[75469]: No targets found.
Nov 14 04:54:07 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:54:07 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:54:07 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ec6197-4927-40e2-9c21-c718088b5d54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2954cd37-4b3f-4153-9fa7-0f69b3092260]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:07 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:07 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:07 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:07 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:07 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:07 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:07 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:07 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:07 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:07 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c65e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bf7816-9367-4c9d-b303-a5e42aa88e93]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5f1f8c-2a6a-4dd6-89dd-2e3533d2407e]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c86b00f-4e29-45b1-b451-663f4c8a66da]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5047a763-0b07-4397-a4b2-6976ae6c5a0c]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26666613963383262', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_63fd3b0', '/dev/disk/by-id/scsi-1SCST_BIO63fd3b0-ffa9c82bbf3acf1b') {{(pid=85531) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edd4c74-9700-4e69-a576-bd58f2b019fa]: (4, None) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG nova.network.neutron [req-e4fb7720-7232-4f98-9ac2-cb9bf1706ce0 req-e1f6ce30-f645-4d3a-a734-cefdaf3a8212 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Updated VIF entry in instance network info cache for port 5f088f44-a1a0-43b4-80de-4dfb8f0480ae. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG nova.network.neutron [req-e4fb7720-7232-4f98-9ac2-cb9bf1706ce0 req-e1f6ce30-f645-4d3a-a734-cefdaf3a8212 service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Updating instance_info_cache with network_info: [{"id": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "address": "fa:16:3e:1c:55:ea", "network": {"id": "3e46277e-112a-447b-931b-653305d97318", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1114632681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc8d826c76141c092339f38b74c6f79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f088f44-a1", "ovs_interfaceid": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.114s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eabe94-25dc-41d4-87e6-fd4b98bccadd]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e4fb7720-7232-4f98-9ac2-cb9bf1706ce0 req-e1f6ce30-f645-4d3a-a734-cefdaf3a8212 service nova] Releasing lock "refresh_cache-1ab6379f-1ffa-4852-a00f-b498b39a2f3d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce5e61b-8c05-44b0-adec-73af3010ea45]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260]
Nov 14 04:54:08 user nova-compute[75469]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:08 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcf355e-5db8-4873-8791-bb1f3f861966]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] <== disconnect_volume: return (453ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:54:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Deleting instance files /opt/stack/data/nova/instances/ccd1b71a-7ecb-4060-bb65-e635222bfcd7_del
Nov 14 04:54:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Deletion of /opt/stack/data/nova/instances/ccd1b71a-7ecb-4060-bb65-e635222bfcd7_del complete
Nov 14 04:54:08 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ccd1b71a-7ecb-4060-bb65-e635222bfcd7 could not be found.
Nov 14 04:54:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtGiQqMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:08 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[290ed3d8-1dbf-443b-926b-baeaad1ac428]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:54:08 user nova-compute[75469]: No targets found.
Nov 14 04:54:08 user nova-compute[75469]: iSNS:
Nov 14 04:54:08 user nova-compute[75469]: No targets found.
Nov 14 04:54:08 user nova-compute[75469]: STATIC:
Nov 14 04:54:08 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a
Nov 14 04:54:08 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:08 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:08 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31
Nov 14 04:54:08 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:08 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:08 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:54:08 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:08 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:08 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417
Nov 14 04:54:08 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:08 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:08 user nova-compute[75469]: FIRMWARE:
Nov 14 04:54:08 user nova-compute[75469]: No targets found.
Nov 14 04:54:08 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:54:08 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:54:08 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[757dcfd9-5fd1-45f9-8e50-9337a914d82d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6f3538-7b25-4b97-b853-6510bd4cd347]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:08 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:08 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:08 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:08 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:08 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:08 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:08 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:08 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa74c247910>, {}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Disconnecting from: [] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] <== disconnect_volume: return (81ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-f4052670-e76e-418f-961b-d8ca886a7098 req-70a2b38a-7650-4512-ba43-ca8ae41fb0a3 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f4052670-e76e-418f-961b-d8ca886a7098 req-70a2b38a-7650-4512-ba43-ca8ae41fb0a3 service nova] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f4052670-e76e-418f-961b-d8ca886a7098 req-70a2b38a-7650-4512-ba43-ca8ae41fb0a3 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f4052670-e76e-418f-961b-d8ca886a7098 req-70a2b38a-7650-4512-ba43-ca8ae41fb0a3 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-f4052670-e76e-418f-961b-d8ca886a7098 req-70a2b38a-7650-4512-ba43-ca8ae41fb0a3 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] No waiting events found dispatching network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:09 user nova-compute[75469]: WARNING nova.compute.manager [req-f4052670-e76e-418f-961b-d8ca886a7098 req-70a2b38a-7650-4512-ba43-ca8ae41fb0a3 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received unexpected event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 for instance with vm_state active and task_state rebuilding.
Nov 14 04:54:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Preparing to wait for external event volume-reimaged-b6d71d08-ba53-43c2-955e-526da6f4836d {{(pid=75469) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKXywQFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:09 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:09 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:09 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae4f697-e566-47a9-a571-c63eab4455e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:54:09 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-9c5ad391-9c96-4ca0-bfcf-e92c788db2c7 req-62fc5648-d4ee-40cb-9564-1456d2324f41 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Received event network-changed-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-9c5ad391-9c96-4ca0-bfcf-e92c788db2c7 req-62fc5648-d4ee-40cb-9564-1456d2324f41 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Refreshing instance network info cache due to event network-changed-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9c5ad391-9c96-4ca0-bfcf-e92c788db2c7 req-62fc5648-d4ee-40cb-9564-1456d2324f41 service nova] Acquiring lock "refresh_cache-071f97b4-296b-43aa-8fa9-cf0a69c9764d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9c5ad391-9c96-4ca0-bfcf-e92c788db2c7 req-62fc5648-d4ee-40cb-9564-1456d2324f41 service nova] Acquired lock "refresh_cache-071f97b4-296b-43aa-8fa9-cf0a69c9764d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-9c5ad391-9c96-4ca0-bfcf-e92c788db2c7 req-62fc5648-d4ee-40cb-9564-1456d2324f41 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Refreshing network info cache for port aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8e163-3329-43b5-a8d2-bf953488c0e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201] added
Nov 14 04:54:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fa1b97-c87e-45e3-8921-719956984fcf]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7253ac-4c7e-46f6-8299-386716495a5c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hKXywQFo {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hKXywQFo" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b9debc-1cb0-4608-9dde-bc8abcac8e30]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hKXywQFo'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f828c390-ec59-43ab-959c-2c6e83d371e6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf9ac69-2fe0-49f2-ba36-68365f2a21a0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[867b483a-3ce9-49dd-a33c-d72c12b4dcdd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201, portal: 172.16.0.220,3260]
Nov 14 04:54:09 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e55f9d-d415-454b-bb08-06b302831e6c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f656125-8308-403b-a03f-f439104ab697]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba667a8e-abca-401b-81f6-0ae1d164d1b2]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKXywQFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-9c5ad391-9c96-4ca0-bfcf-e92c788db2c7 req-62fc5648-d4ee-40cb-9564-1456d2324f41 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Updated VIF entry in instance network info cache for port aa599f35-2b08-4d29-9b68-fecf5f4fcaa8. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-9c5ad391-9c96-4ca0-bfcf-e92c788db2c7 req-62fc5648-d4ee-40cb-9564-1456d2324f41 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Updating instance_info_cache with network_info: [{"id": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "address": "fa:16:3e:13:c1:05", "network": {"id": "daa70d61-704e-4a88-ab73-98f56391d1f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-839348841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84e416fb9684a249adb4fca64d871e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa599f35-2b", "ovs_interfaceid": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9c5ad391-9c96-4ca0-bfcf-e92c788db2c7 req-62fc5648-d4ee-40cb-9564-1456d2324f41 service nova] Releasing lock "refresh_cache-071f97b4-296b-43aa-8fa9-cf0a69c9764d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23230313965636337', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230313965636337', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:54:10 user nova-compute[75469]: DEBUG nova.objects.instance [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lazy-loading 'flavor' on Instance uuid 0faef65d-62e0-4d48-92d5-f50395b7d190 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:54:10 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:10 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 04:54:10 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:10 user nova-compute[75469]:   <serial>89680ce7-14a8-4fb8-a9ee-993031641201</serial>
Nov 14 04:54:10 user nova-compute[75469]: </disk>
Nov 14 04:54:10 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:54:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:10 user nova-compute[75469]: DEBUG nova.objects.instance [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lazy-loading 'flavor' on Instance uuid 071f97b4-296b-43aa-8fa9-cf0a69c9764d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:11 user nova-compute[75469]: INFO nova.compute.manager [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Attaching volume 60b848f1-0aae-4f3d-b9bb-83f0266e14f0 to /dev/sdc
Nov 14 04:54:11 user nova-compute[75469]: DEBUG os_brick.utils [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b63a30b-1a7b-431b-8d3d-bb01bc7c7324]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] No VIF found with MAC fa:16:3e:73:31:86, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce21fa4-c9b6-48cc-ad31-5aeb2940c4e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[14293274-2606-4a8a-8b29-8c1b0bbb7aec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8861c18-f968-4828-8779-b6f862a7b573]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:11 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f25fb8a-21b7-42bc-9bef-82a9156af29a]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG os_brick.utils [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Updating existing volume attachment record: 68336565-5932-47bd-be3f-5a1456ca4dc4 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-568d4ca2-986f-4934-8ba3-aab21450a490 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.783s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-8706b184-2dd7-4fe5-81fa-a68628474865 req-4d88b3d5-6e25-4498-82ae-f1645abedf13 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-changed-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-8706b184-2dd7-4fe5-81fa-a68628474865 req-4d88b3d5-6e25-4498-82ae-f1645abedf13 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Refreshing instance network info cache due to event network-changed-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8706b184-2dd7-4fe5-81fa-a68628474865 req-4d88b3d5-6e25-4498-82ae-f1645abedf13 service nova] Acquiring lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8706b184-2dd7-4fe5-81fa-a68628474865 req-4d88b3d5-6e25-4498-82ae-f1645abedf13 service nova] Acquired lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:11 user nova-compute[75469]: DEBUG nova.network.neutron [req-8706b184-2dd7-4fe5-81fa-a68628474865 req-4d88b3d5-6e25-4498-82ae-f1645abedf13 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Refreshing network info cache for port a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "0faef65d-62e0-4d48-92d5-f50395b7d190" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:12 user nova-compute[75469]: INFO nova.compute.manager [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Detaching volume 89680ce7-14a8-4fb8-a9ee-993031641201
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdsKPQVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:12 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:12 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:12 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bae36d3-814f-46a6-8ee8-3686308742b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:54:12 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e95b97d-683a-406e-912c-a48e62efb8f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6] added
Nov 14 04:54:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:12 user nova-compute[75469]: INFO nova.virt.block_device [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Attempting to driver detach volume 89680ce7-14a8-4fb8-a9ee-993031641201 from mountpoint /dev/vdb
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[04da3b0a-ffbe-4077-9011-847a9153aaf0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Attempting to detach device vdb from instance 0faef65d-62e0-4d48-92d5-f50395b7d190 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:54:12 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:12 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 04:54:12 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:12 user nova-compute[75469]:   <serial>89680ce7-14a8-4fb8-a9ee-993031641201</serial>
Nov 14 04:54:12 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:54:12 user nova-compute[75469]: </disk>
Nov 14 04:54:12 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Successfully detached device vdb from instance 0faef65d-62e0-4d48-92d5-f50395b7d190 from the persistent domain config.
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0faef65d-62e0-4d48-92d5-f50395b7d190 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:54:12 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:12 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 04:54:12 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:12 user nova-compute[75469]:   <serial>89680ce7-14a8-4fb8-a9ee-993031641201</serial>
Nov 14 04:54:12 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:54:12 user nova-compute[75469]: </disk>
Nov 14 04:54:12 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d0c9dd-c5ee-4fbd-9131-749a7878ae3b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdsKPQVS {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdsKPQVS" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6190c8-daf0-48cd-8410-b5d8917bbfc3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xdsKPQVS'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebfe971-94fa-40cd-aa86-d827c3ca54a1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.network.neutron [req-8706b184-2dd7-4fe5-81fa-a68628474865 req-4d88b3d5-6e25-4498-82ae-f1645abedf13 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Updated VIF entry in instance network info cache for port a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.network.neutron [req-8706b184-2dd7-4fe5-81fa-a68628474865 req-4d88b3d5-6e25-4498-82ae-f1645abedf13 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Updating instance_info_cache with network_info: [{"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8706b184-2dd7-4fe5-81fa-a68628474865 req-4d88b3d5-6e25-4498-82ae-f1645abedf13 service nova] Releasing lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[011de491-87b1-45aa-846e-f10c1c7680d3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "interface-c32dcf16-daa4-4370-be69-ebeba12e2b12-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "interface-c32dcf16-daa4-4370-be69-ebeba12e2b12-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lazy-loading 'flavor' on Instance uuid c32dcf16-daa4-4370-be69-ebeba12e2b12 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed0a768-e15c-40ce-aeff-dcadc28bb881]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260]
Nov 14 04:54:12 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2c78a5-a7a8-4a9d-90d8-b49fefe2c04c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[14247eee-4b33-4acb-832a-39aeab6c0353]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca0e13-335f-469d-838f-4e891a65f4ac]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdsKPQVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lazy-loading 'pci_requests' on Instance uuid c32dcf16-daa4-4370-be69-ebeba12e2b12 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.objects.base [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Object Instance<c32dcf16-daa4-4370-be69-ebeba12e2b12> lazy-loaded attributes: flavor,pci_requests {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.network.neutron [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0faef65d-62e0-4d48-92d5-f50395b7d190 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:54:12 user nova-compute[75469]: DEBUG nova.policy [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4371d2e15d6486b8b6aafd72905b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab74b837d742b2bf746eaf0f8a8d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:54:13 user nova-compute[75469]: DEBUG nova.network.neutron [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Successfully created port: 079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:54:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23464386530663332', 'path': '/dev/sdg'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464386530663332', 'path': '/dev/sdg'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:54:13 user nova-compute[75469]: DEBUG nova.objects.instance [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lazy-loading 'flavor' on Instance uuid 1ab6379f-1ffa-4852-a00f-b498b39a2f3d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:54:13 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:13 user nova-compute[75469]:   <source dev="/dev/sdg"/>
Nov 14 04:54:13 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:13 user nova-compute[75469]:   <serial>7579bc3a-c6b8-47b6-a373-20c04568e4b6</serial>
Nov 14 04:54:13 user nova-compute[75469]: </disk>
Nov 14 04:54:13 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.network.neutron [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Successfully updated port: 079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquired lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.network.neutron [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-9bbf1a22-7e71-4b4e-a62f-8c3d5cc94721 req-2aa5d9b7-a1fa-4b4a-afb6-9ba63a6623a2 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-changed-079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-9bbf1a22-7e71-4b4e-a62f-8c3d5cc94721 req-2aa5d9b7-a1fa-4b4a-afb6-9ba63a6623a2 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Refreshing instance network info cache due to event network-changed-079c1d45-5dc2-493b-b3cd-27433bb99386. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9bbf1a22-7e71-4b4e-a62f-8c3d5cc94721 req-2aa5d9b7-a1fa-4b4a-afb6-9ba63a6623a2 service nova] Acquiring lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] No VIF found with MAC fa:16:3e:1c:55:ea, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-99197575-d4c9-4263-8b82-c3a6e396580b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.999s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.network.neutron [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Updating instance_info_cache with network_info: [{"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "079c1d45-5dc2-493b-b3cd-27433bb99386", "address": "fa:16:3e:47:84:56", "network": {"id": "53b318a2-3540-4714-95db-1e1a1ccaf111", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1699408991", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079c1d45-5d", "ovs_interfaceid": "079c1d45-5dc2-493b-b3cd-27433bb99386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Releasing lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9bbf1a22-7e71-4b4e-a62f-8c3d5cc94721 req-2aa5d9b7-a1fa-4b4a-afb6-9ba63a6623a2 service nova] Acquired lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.network.neutron [req-9bbf1a22-7e71-4b4e-a62f-8c3d5cc94721 req-2aa5d9b7-a1fa-4b4a-afb6-9ba63a6623a2 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Refreshing network info cache for port 079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-4526189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-4526189',id=10,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO++5P4KL/ZlD2ZzykOgGS1QHT6rp4SrhnI8T9uGc2ieskb1Zpm1kRlcju/ARTYmnDKlMLY/nhtyrzPX47AoyAGkHDc3X9h1UXq82L6/7cPAy7R2c05pO9fh3r7p59j+EA==',key_name='tempest-keypair-1149227935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cab74b837d742b2bf746eaf0f8a8d5f',ramdisk_id='',reservation_id='r-r4mmdsm7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1158979709',owner_user_name='tempest-TaggedAttachmentsTest-1158979709-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4371d2e15d6486b8b6aafd72905b1e5',uuid=c32dcf16-daa4-4370-be69-ebeba12e2b12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "079c1d45-5dc2-493b-b3cd-27433bb99386", "address": "fa:16:3e:47:84:56", "network": {"id": "53b318a2-3540-4714-95db-1e1a1ccaf111", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1699408991", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079c1d45-5d", "ovs_interfaceid": "079c1d45-5dc2-493b-b3cd-27433bb99386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converting VIF {"id": "079c1d45-5dc2-493b-b3cd-27433bb99386", "address": "fa:16:3e:47:84:56", "network": {"id": "53b318a2-3540-4714-95db-1e1a1ccaf111", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1699408991", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079c1d45-5d", "ovs_interfaceid": "079c1d45-5dc2-493b-b3cd-27433bb99386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:84:56,bridge_name='br-int',has_traffic_filtering=True,id=079c1d45-5dc2-493b-b3cd-27433bb99386,network=Network(53b318a2-3540-4714-95db-1e1a1ccaf111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079c1d45-5d') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG os_vif [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:84:56,bridge_name='br-int',has_traffic_filtering=True,id=079c1d45-5dc2-493b-b3cd-27433bb99386,network=Network(53b318a2-3540-4714-95db-1e1a1ccaf111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079c1d45-5d') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7684bf9-7167-5651-961a-0649df187236', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap079c1d45-5d, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap079c1d45-5d, col_values=(('qos', UUID('727a7b1d-3adc-4835-8807-bb91d463e389')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap079c1d45-5d, col_values=(('external_ids', {'iface-id': '079c1d45-5dc2-493b-b3cd-27433bb99386', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:84:56', 'vm-uuid': 'c32dcf16-daa4-4370-be69-ebeba12e2b12'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:14 user nova-compute[75469]: INFO os_vif [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:84:56,bridge_name='br-int',has_traffic_filtering=True,id=079c1d45-5dc2-493b-b3cd-27433bb99386,network=Network(53b318a2-3540-4714-95db-1e1a1ccaf111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079c1d45-5d')
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-4526189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-4526189',id=10,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO++5P4KL/ZlD2ZzykOgGS1QHT6rp4SrhnI8T9uGc2ieskb1Zpm1kRlcju/ARTYmnDKlMLY/nhtyrzPX47AoyAGkHDc3X9h1UXq82L6/7cPAy7R2c05pO9fh3r7p59j+EA==',key_name='tempest-keypair-1149227935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cab74b837d742b2bf746eaf0f8a8d5f',ramdisk_id='',reservation_id='r-r4mmdsm7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1158979709',owner_user_name='tempest-TaggedAttachmentsTest-1158979709-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4371d2e15d6486b8b6aafd72905b1e5',uuid=c32dcf16-daa4-4370-be69-ebeba12e2b12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "079c1d45-5dc2-493b-b3cd-27433bb99386", "address": "fa:16:3e:47:84:56", "network": {"id": "53b318a2-3540-4714-95db-1e1a1ccaf111", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1699408991", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079c1d45-5d", "ovs_interfaceid": "079c1d45-5dc2-493b-b3cd-27433bb99386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converting VIF {"id": "079c1d45-5dc2-493b-b3cd-27433bb99386", "address": "fa:16:3e:47:84:56", "network": {"id": "53b318a2-3540-4714-95db-1e1a1ccaf111", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1699408991", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079c1d45-5d", "ovs_interfaceid": "079c1d45-5dc2-493b-b3cd-27433bb99386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:84:56,bridge_name='br-int',has_traffic_filtering=True,id=079c1d45-5dc2-493b-b3cd-27433bb99386,network=Network(53b318a2-3540-4714-95db-1e1a1ccaf111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079c1d45-5d') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] attach device xml: <interface type="ethernet">
Nov 14 04:54:14 user nova-compute[75469]:   <mac address="fa:16:3e:47:84:56"/>
Nov 14 04:54:14 user nova-compute[75469]:   <model type="virtio"/>
Nov 14 04:54:14 user nova-compute[75469]:   <mtu size="1442"/>
Nov 14 04:54:14 user nova-compute[75469]:   <target dev="tap079c1d45-5d"/>
Nov 14 04:54:14 user nova-compute[75469]: </interface>
Nov 14 04:54:14 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG nova.network.neutron [req-9bbf1a22-7e71-4b4e-a62f-8c3d5cc94721 req-2aa5d9b7-a1fa-4b4a-afb6-9ba63a6623a2 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Updated VIF entry in instance network info cache for port 079c1d45-5dc2-493b-b3cd-27433bb99386. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG nova.network.neutron [req-9bbf1a22-7e71-4b4e-a62f-8c3d5cc94721 req-2aa5d9b7-a1fa-4b4a-afb6-9ba63a6623a2 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Updating instance_info_cache with network_info: [{"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "079c1d45-5dc2-493b-b3cd-27433bb99386", "address": "fa:16:3e:47:84:56", "network": {"id": "53b318a2-3540-4714-95db-1e1a1ccaf111", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1699408991", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079c1d45-5d", "ovs_interfaceid": "079c1d45-5dc2-493b-b3cd-27433bb99386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] No BDM found with device name hda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] No VIF found with MAC fa:16:3e:b1:29:fb, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9bbf1a22-7e71-4b4e-a62f-8c3d5cc94721 req-2aa5d9b7-a1fa-4b4a-afb6-9ba63a6623a2 service nova] Releasing lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:54:15 user nova-compute[75469]:   <nova:package version="0.0.0"/>
Nov 14 04:54:15 user nova-compute[75469]:   <nova:name>tempest-device-tagging-server-4526189</nova:name>
Nov 14 04:54:15 user nova-compute[75469]:   <nova:creationTime>2023-11-14 04:54:15</nova:creationTime>
Nov 14 04:54:15 user nova-compute[75469]:   <nova:flavor name="m1.tiny">
Nov 14 04:54:15 user nova-compute[75469]:     <nova:memory>512</nova:memory>
Nov 14 04:54:15 user nova-compute[75469]:     <nova:disk>1</nova:disk>
Nov 14 04:54:15 user nova-compute[75469]:     <nova:swap>0</nova:swap>
Nov 14 04:54:15 user nova-compute[75469]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:54:15 user nova-compute[75469]:     <nova:vcpus>1</nova:vcpus>
Nov 14 04:54:15 user nova-compute[75469]:   </nova:flavor>
Nov 14 04:54:15 user nova-compute[75469]:   <nova:owner>
Nov 14 04:54:15 user nova-compute[75469]:     <nova:user uuid="c4371d2e15d6486b8b6aafd72905b1e5">tempest-TaggedAttachmentsTest-1158979709-project-member</nova:user>
Nov 14 04:54:15 user nova-compute[75469]:     <nova:project uuid="4cab74b837d742b2bf746eaf0f8a8d5f">tempest-TaggedAttachmentsTest-1158979709</nova:project>
Nov 14 04:54:15 user nova-compute[75469]:   </nova:owner>
Nov 14 04:54:15 user nova-compute[75469]:   <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:54:15 user nova-compute[75469]:   <nova:ports>
Nov 14 04:54:15 user nova-compute[75469]:     <nova:port uuid="a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f">
Nov 14 04:54:15 user nova-compute[75469]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 04:54:15 user nova-compute[75469]:     </nova:port>
Nov 14 04:54:15 user nova-compute[75469]:     <nova:port uuid="079c1d45-5dc2-493b-b3cd-27433bb99386">
Nov 14 04:54:15 user nova-compute[75469]:       <nova:ip type="fixed" address="10.10.10.8" ipVersion="4"/>
Nov 14 04:54:15 user nova-compute[75469]:     </nova:port>
Nov 14 04:54:15 user nova-compute[75469]:   </nova:ports>
Nov 14 04:54:15 user nova-compute[75469]: </nova:instance>
Nov 14 04:54:15 user nova-compute[75469]:  {{(pid=75469) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-f5da6343-def6-4cf7-ae8b-1b9785fbced0 req-25e980f9-5c66-4186-8f2c-35034c45d010 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-vif-plugged-079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f5da6343-def6-4cf7-ae8b-1b9785fbced0 req-25e980f9-5c66-4186-8f2c-35034c45d010 service nova] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f5da6343-def6-4cf7-ae8b-1b9785fbced0 req-25e980f9-5c66-4186-8f2c-35034c45d010 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f5da6343-def6-4cf7-ae8b-1b9785fbced0 req-25e980f9-5c66-4186-8f2c-35034c45d010 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-f5da6343-def6-4cf7-ae8b-1b9785fbced0 req-25e980f9-5c66-4186-8f2c-35034c45d010 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] No waiting events found dispatching network-vif-plugged-079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:15 user nova-compute[75469]: WARNING nova.compute.manager [req-f5da6343-def6-4cf7-ae8b-1b9785fbced0 req-25e980f9-5c66-4186-8f2c-35034c45d010 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received unexpected event network-vif-plugged-079c1d45-5dc2-493b-b3cd-27433bb99386 for instance with vm_state active and task_state None.
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-702bc13c-60cb-476b-adec-4fc965536cb2 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "interface-c32dcf16-daa4-4370-be69-ebeba12e2b12-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.853s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lazy-loading 'flavor' on Instance uuid c32dcf16-daa4-4370-be69-ebeba12e2b12 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG os_brick.utils [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfe5d58-a2a8-4001-8e1a-40b94bcf12fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d1ee7b-97b3-4eec-bfbc-05cc2253ca2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b6082e-65c7-4542-a4cf-e431f4d312c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[887cf29a-735d-4339-a4fd-fcd1ee1c8b19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:15 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f891f03b-7d1d-4aac-a1b8-b35a201eaacb]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG os_brick.utils [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:15 user nova-compute[75469]: INFO nova.compute.manager [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Attaching volume abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 to /dev/vdb
Nov 14 04:54:15 user nova-compute[75469]: INFO nova.compute.manager [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Swapping volume 7579bc3a-c6b8-47b6-a373-20c04568e4b6 for bb11af0f-eac6-44e1-b526-00487f454c9a
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.utils [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[376b1224-a2f7-4e18-a6b4-f7d523712738]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c25c1bd-b41e-4a0f-aabd-aee986de913e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4104bd46-479b-4ef0-94d2-74dbc927ea9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[02339841-8c7c-4a56-9e1e-5a2aa92fb113]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:16 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5da589a-318d-42fe-a246-727bcc3b901b]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.utils [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Updating existing volume attachment record: 5dc3a9c3-9afd-47b0-9572-a29893a528fc {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'covbPnSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:16 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:16 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:16 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[63104d71-3b4c-4481-bb54-71be56f9ff6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:54:16 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d71796-528e-4862-8c01-f68b80b599c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0] added
Nov 14 04:54:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46de176-df60-4399-a155-05e915f7240d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9e157f-af30-4fbd-a320-5d562cc8d083]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v covbPnSh {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v covbPnSh" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4444e00-a7d1-4378-89cd-7a960ae4ed4d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'covbPnSh'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd530b9-b376-4432-942b-30edaa37695a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c750eee9-e04c-4b79-b3c1-074a834693e1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Acquiring lock "42daead3-8494-429a-8915-cb88ad87496a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "42daead3-8494-429a-8915-cb88ad87496a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lazy-loading 'flavor' on Instance uuid 42daead3-8494-429a-8915-cb88ad87496a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[03449977-a8da-4c49-b99e-01dcda86e7b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0, portal: 172.16.0.220,3260]
Nov 14 04:54:16 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6eae8e-80f0-409b-b294-d6abf5be567f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "42daead3-8494-429a-8915-cb88ad87496a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c711987-fb28-4470-9e73-d20d4e71796b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd67c80-ccd5-4b36-8525-23fed0c34355]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:54:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'covbPnSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Acquiring lock "42daead3-8494-429a-8915-cb88ad87496a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "42daead3-8494-429a-8915-cb88ad87496a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:17 user nova-compute[75469]: INFO nova.compute.manager [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Attaching volume a316d067-1df3-4ea2-9390-00e967d16429 to /dev/vdb
Nov 14 04:54:17 user nova-compute[75469]: DEBUG os_brick.utils [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f32203-c0aa-4b4e-a1a2-28a04e193868]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9da4f04-e24a-428b-af63-c5de3361eb2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0b2dac-3b8f-4e18-b1de-cc5f043c0e3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[24302d47-eae3-4b20-8387-3baa68943750]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:17 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b676e951-ed17-4acd-b738-cb670fed96f3]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG os_brick.utils [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Updating existing volume attachment record: 46e8bccb-8fee-4411-94f1-9fd146976ac8 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-vif-plugged-079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] No waiting events found dispatching network-vif-plugged-079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:17 user nova-compute[75469]: WARNING nova.compute.manager [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received unexpected event network-vif-plugged-079c1d45-5dc2-493b-b3cd-27433bb99386 for instance with vm_state active and task_state None.
Nov 14 04:54:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Received event network-changed-679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Refreshing instance network info cache due to event network-changed-679bdb9b-cea2-4445-95b1-ea3238205986. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] Acquiring lock "refresh_cache-42daead3-8494-429a-8915-cb88ad87496a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] Acquired lock "refresh_cache-42daead3-8494-429a-8915-cb88ad87496a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Refreshing network info cache for port 679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23461613931626639', 'path': '/dev/sdi'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461613931626639', 'path': '/dev/sdi'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG nova.objects.instance [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lazy-loading 'flavor' on Instance uuid 071f97b4-296b-43aa-8fa9-cf0a69c9764d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Updated VIF entry in instance network info cache for port 679bdb9b-cea2-4445-95b1-ea3238205986. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Updating instance_info_cache with network_info: [{"id": "679bdb9b-cea2-4445-95b1-ea3238205986", "address": "fa:16:3e:3c:20:95", "network": {"id": "36c1ae2e-640a-4264-81a8-398fc34f70d4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1580795687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2376409c2e1f48caaf8e8c8b806a9d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679bdb9b-ce", "ovs_interfaceid": "679bdb9b-cea2-4445-95b1-ea3238205986", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-67d0263c-7d15-461f-9663-e7fcf7965bd8 req-e71469be-f57e-4cff-a3da-645db04d40b5 service nova] Releasing lock "refresh_cache-42daead3-8494-429a-8915-cb88ad87496a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:54:17 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:17 user nova-compute[75469]:   <source dev="/dev/sdi"/>
Nov 14 04:54:17 user nova-compute[75469]:   <target dev="sdc" bus="scsi"/>
Nov 14 04:54:17 user nova-compute[75469]:   <serial>60b848f1-0aae-4f3d-b9bb-83f0266e14f0</serial>
Nov 14 04:54:17 user nova-compute[75469]:   <address type="drive" controller="0" unit="2"/>
Nov 14 04:54:17 user nova-compute[75469]: </disk>
Nov 14 04:54:17 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:54:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] No BDM found with device name sda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] No VIF found with MAC fa:16:3e:13:c1:05, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:54:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COqKaSLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:21 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:21 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:21 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBtTysoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ab6379f-1ffa-4852-a00f-b498b39a2f3d', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb11af0f-eac6-44e1-b526-00487f454c9a', 'serial': 'bb11af0f-eac6-44e1-b526-00487f454c9a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdsKPQVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '1ab6379f-1ffa-4852-a00f-b498b39a2f3d', 'attached_at': '', 'detached_at': '', 'volume_id': '7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'serial'} {{(pid=75469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBtTysoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:21 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[048d126c-ed62-469a-8e09-fce1f41b11a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:54:21 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88c1f99-a699-494c-aa10-e62138367fef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6] added
Nov 14 04:54:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[20121055-d9b3-41ad-aac8-4f4316f0c922]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.109s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f537fd35-c4b7-4678-851b-8fdc14eba431]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v COqKaSLE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v COqKaSLE" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cd7c5f-7891-4e75-8f2e-0ec017a470e6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'COqKaSLE'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-47be61d7-65b8-4b43-84f5-0984986f98d8 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.381s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cc24a2-6338-4a2c-9dff-d54800068298]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b491451a-29ac-4b87-9aba-453d95d54c10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f27b12-ab17-404c-a731-0c0da1edb360]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6, portal: 172.16.0.220,3260]
Nov 14 04:54:21 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45c542e-097a-4188-bfe9-12b364285c86]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8651831c-748e-4a1a-9423-4bb4fba534f9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.493s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b06ceb1-a487-445e-a182-e93ef32ddb01]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:54:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COqKaSLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.539s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] <== connect_volume: return (1541ms) {'type': 'block', 'scsi_wwn': '23830396630643664', 'path': '/dev/sdj'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830396630643664', 'path': '/dev/sdj'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.529s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:22 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:22 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZfESAPRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:22 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lazy-loading 'flavor' on Instance uuid c32dcf16-daa4-4370-be69-ebeba12e2b12 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bb360a-6f41-4171-8063-23702d458564]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:54:22 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd1933c-b4f9-453f-8f83-ba6662b38f94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a] added
Nov 14 04:54:22 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:54:22 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:22 user nova-compute[75469]:   <source dev="/dev/sdj"/>
Nov 14 04:54:22 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:22 user nova-compute[75469]:   <serial>abe2b2d7-f4be-4950-aac6-fcc11e2d97a6</serial>
Nov 14 04:54:22 user nova-compute[75469]: </disk>
Nov 14 04:54:22 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec1e8ca-1154-4d05-839f-f3f98e88cdf6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4e47e4-8a25-4f67-89ad-2197ba65aa01]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBtTysoj {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBtTysoj" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e16555-ff0a-41d4-8312-5c0e3475f7c5]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DBtTysoj'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:22 user nova-compute[75469]: INFO nova.compute.manager [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Detaching volume 60b848f1-0aae-4f3d-b9bb-83f0266e14f0
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 6 in 0.041s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[eddae36a-b0dd-4339-96ed-eae51b47e94d]: Unexpected error while running command.
Nov 14 04:54:22 user nova-compute[75469]: Command: iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***
Nov 14 04:54:22 user nova-compute[75469]: Exit code: 6
Nov 14 04:54:22 user nova-compute[75469]: Stdout: ''
Nov 14 04:54:22 user nova-compute[75469]: Stderr: 'iscsiadm: Could not execute operation on all records: encountered iSCSI database failure\n' {{(pid=85531) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 14 04:54:22 user nova-compute[75469]: Traceback (most recent call last):
Nov 14 04:54:22 user nova-compute[75469]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 14 04:54:22 user nova-compute[75469]:     ret = func(*f_args, **f_kwargs)
Nov 14 04:54:22 user nova-compute[75469]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 14 04:54:22 user nova-compute[75469]:     return func(*args, **kwargs)
Nov 14 04:54:22 user nova-compute[75469]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 14 04:54:22 user nova-compute[75469]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 14 04:54:22 user nova-compute[75469]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 14 04:54:22 user nova-compute[75469]:     return putils.execute(on_execute=on_execute,
Nov 14 04:54:22 user nova-compute[75469]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 14 04:54:22 user nova-compute[75469]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 14 04:54:22 user nova-compute[75469]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 04:54:22 user nova-compute[75469]: Command: iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***
Nov 14 04:54:22 user nova-compute[75469]: Exit code: 6
Nov 14 04:54:22 user nova-compute[75469]: Stdout: ''
Nov 14 04:54:22 user nova-compute[75469]: Stderr: 'iscsiadm: Could not execute operation on all records: encountered iSCSI database failure\n'
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddae36a-b0dd-4339-96ed-eae51b47e94d]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('', 'iscsiadm: Could not execute operation on all records: encountered iSCSI database failure\n', 6, 'iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***', None)) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.203s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Exception connecting to 172.16.0.220:3260: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 04:54:22 user nova-compute[75469]: Command: iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***
Nov 14 04:54:22 user nova-compute[75469]: Exit code: 6
Nov 14 04:54:22 user nova-compute[75469]: Stdout: ''
Nov 14 04:54:22 user nova-compute[75469]: Stderr: 'iscsiadm: Could not execute operation on all records: encountered iSCSI database failure\n'
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 627, in _connect_vol
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     session, manual_scan = self._connect_to_iscsi_portal(props)
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1074, in _connect_to_iscsi_portal
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     return method(connection_properties)
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py", line 78, in inner
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     return f(*args, **kwargs)
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py", line 97, in _wrapper
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     return r(f, *args, **kwargs)
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/tenacity/__init__.py", line 423, in __call__
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     do = self.iter(retry_state=retry_state)
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/tenacity/__init__.py", line 360, in iter
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     return fut.result()
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     return self.__get_result()
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     raise self._exception
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/tenacity/__init__.py", line 426, in __call__
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     result = fn(*args, **kwargs)
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1125, in _connect_to_iscsi_portal_unsafe
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     self._iscsiadm_update(connection_properties,
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1045, in _iscsiadm_update
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     return self._run_iscsiadm(connection_properties, iscsi_command,
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1025, in _run_iscsiadm
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm', '-m', 'node', '-T',
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi Exit code: 6
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi Stdout: ''
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi Stderr: 'iscsiadm: Could not execute operation on all records: encountered iSCSI database failure\n'
Nov 14 04:54:22 user nova-compute[75469]: ERROR os_brick.initiator.connectors.iscsi 
Nov 14 04:54:22 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Failed to connect to iSCSI portal 172.16.0.220:3260.
Nov 14 04:54:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[190de3a0-25b4-412c-a9fa-23c0c5805ec2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12a76d2-d0d1-4361-8460-2edeaf6598e6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:23 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa74c247010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a'): (set(), set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:23 user nova-compute[75469]: INFO nova.virt.block_device [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Attempting to driver detach volume 60b848f1-0aae-4f3d-b9bb-83f0266e14f0 from mountpoint /dev/sdc
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Attempting to detach device sdc from instance 071f97b4-296b-43aa-8fa9-cf0a69c9764d from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:54:23 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:23 user nova-compute[75469]:   <source dev="/dev/sdi"/>
Nov 14 04:54:23 user nova-compute[75469]:   <target dev="sdc" bus="scsi"/>
Nov 14 04:54:23 user nova-compute[75469]:   <serial>60b848f1-0aae-4f3d-b9bb-83f0266e14f0</serial>
Nov 14 04:54:23 user nova-compute[75469]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 04:54:23 user nova-compute[75469]: </disk>
Nov 14 04:54:23 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Successfully detached device sdc from instance 071f97b4-296b-43aa-8fa9-cf0a69c9764d from the persistent domain config.
Nov 14 04:54:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 071f97b4-296b-43aa-8fa9-cf0a69c9764d from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:54:23 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:23 user nova-compute[75469]:   <source dev="/dev/sdi"/>
Nov 14 04:54:23 user nova-compute[75469]:   <target dev="sdc" bus="scsi"/>
Nov 14 04:54:23 user nova-compute[75469]:   <serial>60b848f1-0aae-4f3d-b9bb-83f0266e14f0</serial>
Nov 14 04:54:23 user nova-compute[75469]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 04:54:23 user nova-compute[75469]: </disk>
Nov 14 04:54:23 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b13f19e-b553-4237-90ce-9a0d23e97929]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --logout" returned: 21 in 0.036s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9a226c-d429-4edc-ac60-09b19fc9f9ea]: (4, ('', 'iscsiadm: No matching sessions found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--logout',): stdout= stderr=iscsiadm: No matching sessions found
Nov 14 04:54:23 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[933e2478-5560-49c1-88c4-f649b1c07fb1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG os_brick.utils [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_single_volume' after 0.388(s), this was the 1st time calling it. {{(pid=75469) log_it /opt/stack/data/venv/lib/python3.10/site-packages/tenacity/after.py:30}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG os_brick.utils [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_single_volume in 1.0 seconds as it raised VolumeDeviceNotFound: Volume device not found at .. {{(pid=75469) log_it /opt/stack/data/venv/lib/python3.10/site-packages/tenacity/before_sleep.py:40}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] No BDM found with device name hda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] No VIF found with MAC fa:16:3e:b1:29:fb, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3f896ea4-d2fd-42e6-8b34-d2ef5cfaca6c tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.530s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 071f97b4-296b-43aa-8fa9-cf0a69c9764d {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 req-c7f98f65-865e-4c84-b08f-6e4f9cce5ff3 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event volume-reimaged-b6d71d08-ba53-43c2-955e-526da6f4836d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 req-c7f98f65-865e-4c84-b08f-6e4f9cce5ff3 service nova] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 req-c7f98f65-865e-4c84-b08f-6e4f9cce5ff3 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 req-c7f98f65-865e-4c84-b08f-6e4f9cce5ff3 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 req-c7f98f65-865e-4c84-b08f-6e4f9cce5ff3 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Processing event volume-reimaged-b6d71d08-ba53-43c2-955e-526da6f4836d {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:54:24 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:24 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1218af-0a88-4dda-bc29-41a6dee4e447]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:54:24 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: INFO nova.virt.block_device [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Booting with volume b6d71d08-ba53-43c2-955e-526da6f4836d at /dev/vda
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8948a68-b877-45c9-b12d-b38909c6b33e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a] added
Nov 14 04:54:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf6d6b0-60b0-4a3b-9551-dd9f9f8d65d1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5736deb-b9a2-473c-b0ab-6320afd000e1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBtTysoj {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.utils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c065709-5da2-49a0-81a3-530572e92ec1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: INFO nova.compute.manager [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Detaching volume abe2b2d7-f4be-4950-aac6-fcc11e2d97a6
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBtTysoj" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1307e540-8099-4ecc-a58f-db56043469a2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DBtTysoj'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[498b5d17-5a11-4221-be04-ec7966c82a19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c14ad5-038e-46a7-b5d3-6c5e3285dcae]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3735870-ce77-40a7-84fe-223a7356d2c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e1170b-2a96-439d-bccd-d582ec7b7fed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4c5bec-8a11-4c08-8a09-f20ef9a8b5a9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: INFO nova.virt.block_device [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Attempting to driver detach volume abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 from mountpoint /dev/vdb
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:24 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:54:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Attempting to detach device vdb from instance c32dcf16-daa4-4370-be69-ebeba12e2b12 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:54:24 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:24 user nova-compute[75469]:   <source dev="/dev/sdj"/>
Nov 14 04:54:24 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:24 user nova-compute[75469]:   <serial>abe2b2d7-f4be-4950-aac6-fcc11e2d97a6</serial>
Nov 14 04:54:24 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 04:54:24 user nova-compute[75469]: </disk>
Nov 14 04:54:24 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[da37fd83-368b-480b-9b01-7a6b03d0184a]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.utils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Updating existing volume attachment record: bf15a47d-a782-4119-a61d-54af583f17dd {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:54:24 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Successfully detached device vdb from instance c32dcf16-daa4-4370-be69-ebeba12e2b12 from the persistent domain config.
Nov 14 04:54:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c32dcf16-daa4-4370-be69-ebeba12e2b12 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:54:24 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:24 user nova-compute[75469]:   <source dev="/dev/sdj"/>
Nov 14 04:54:24 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:24 user nova-compute[75469]:   <serial>abe2b2d7-f4be-4950-aac6-fcc11e2d97a6</serial>
Nov 14 04:54:24 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 04:54:24 user nova-compute[75469]: </disk>
Nov 14 04:54:24 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ad898f-f30e-4f56-bcec-00adb7dc2066]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a, portal: 172.16.0.220,3260]
Nov 14 04:54:24 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d6d123-130b-410e-afe9-410ae51f089c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[86053a47-940c-4151-91bd-3f8fbb12a4cf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] HCTL ('39', '-', '-', 0) found on session 13 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1bcaf0-d0f0-4e24-9bd0-a87b15a2fc14]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBtTysoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c32dcf16-daa4-4370-be69-ebeba12e2b12 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.814s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] <== connect_volume: return (4344ms) {'type': 'block', 'scsi_wwn': '23764623765656164', 'path': '/dev/sdh'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764623765656164', 'path': '/dev/sdh'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.809s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:25 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:25 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG nova.objects.instance [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lazy-loading 'flavor' on Instance uuid 1ab6379f-1ffa-4852-a00f-b498b39a2f3d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9ab114-25f9-4e6d-99ea-9ea7a2ad56e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:54:25 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca74017-2c3e-4491-ab32-daac3a3d5a57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429] added
Nov 14 04:54:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8951c281-8bad-46a9-91b2-90c706e20aa1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3314542-2c0f-4b03-8af4-4c81162f387b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZfESAPRo {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZfESAPRo" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e3c5cc-39b0-435b-8299-a7ac65a57234]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZfESAPRo'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a10152-6c25-4342-821c-11a16d91a00a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.079s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cd49ff-fff0-4d93-804f-d729bc25c9e4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-ad9e6135-35bd-40a1-8f29-c4fb0775f99a req-8e57cfbc-483a-4e68-9db5-d1419482d39e service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-changed-0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-ad9e6135-35bd-40a1-8f29-c4fb0775f99a req-8e57cfbc-483a-4e68-9db5-d1419482d39e service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing instance network info cache due to event network-changed-0024bc5b-8f80-467c-9e6a-a70926a62b40. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ad9e6135-35bd-40a1-8f29-c4fb0775f99a req-8e57cfbc-483a-4e68-9db5-d1419482d39e service nova] Acquiring lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ad9e6135-35bd-40a1-8f29-c4fb0775f99a req-8e57cfbc-483a-4e68-9db5-d1419482d39e service nova] Acquired lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG nova.network.neutron [req-ad9e6135-35bd-40a1-8f29-c4fb0775f99a req-8e57cfbc-483a-4e68-9db5-d1419482d39e service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Refreshing network info cache for port 0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea476534-e44b-40f5-ae2e-3066bfab9e36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429, portal: 172.16.0.220,3260]
Nov 14 04:54:25 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.046s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c01909-0c49-4342-8075-d27d0026705b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1171622-a56b-425c-926e-7b10003a7f47]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:54:25 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:54:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:54:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9780e7f8-62db-472b-b466-6695c24e5dc2]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:54:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-ad9e6135-35bd-40a1-8f29-c4fb0775f99a req-8e57cfbc-483a-4e68-9db5-d1419482d39e service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updated VIF entry in instance network info cache for port 0024bc5b-8f80-467c-9e6a-a70926a62b40. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:54:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-ad9e6135-35bd-40a1-8f29-c4fb0775f99a req-8e57cfbc-483a-4e68-9db5-d1419482d39e service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating instance_info_cache with network_info: [{"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "address": "fa:16:3e:80:6d:38", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df00d8e-ee", "ovs_interfaceid": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ad9e6135-35bd-40a1-8f29-c4fb0775f99a req-8e57cfbc-483a-4e68-9db5-d1419482d39e service nova] Releasing lock "refresh_cache-4a3ad0cf-02b2-45af-a36e-225a14b972db" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 336592896 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZfESAPRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] <== connect_volume: return (4289ms) {'type': 'block', 'scsi_wwn': '23439663934303637', 'path': '/dev/sdk'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439663934303637', 'path': '/dev/sdk'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lazy-loading 'flavor' on Instance uuid 42daead3-8494-429a-8915-cb88ad87496a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 04:54:27 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:27 user nova-compute[75469]:   <source dev="/dev/sdk"/>
Nov 14 04:54:27 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:27 user nova-compute[75469]:   <serial>a316d067-1df3-4ea2-9390-00e967d16429</serial>
Nov 14 04:54:27 user nova-compute[75469]: </disk>
Nov 14 04:54:27 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 505413632 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] No VIF found with MAC fa:16:3e:3c:20:95, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:54:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4d42cd8d-da1e-4c4a-a966-4a9fc33de9af tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "42daead3-8494-429a-8915-cb88ad87496a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.798s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 674234368 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 775946240 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe562371-5ed3-43d1-aa2b-34cbbb44ba4e tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] [instance: 42daead3-8494-429a-8915-cb88ad87496a] volume_snapshot_create: create_info: {'snapshot_id': 'd90e7d35-1fe3-455b-8ba0-cc103629c8c2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75469) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 910163968 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fe562371-5ed3-43d1-aa2b-34cbbb44ba4e tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] [instance: 42daead3-8494-429a-8915-cb88ad87496a] snap xml: <domainsnapshot>
Nov 14 04:54:29 user nova-compute[75469]:   <disks>
Nov 14 04:54:29 user nova-compute[75469]:     <disk name="/dev/sdk" snapshot="external" type="file">
Nov 14 04:54:29 user nova-compute[75469]:       <source file="/dev/new_file"/>
Nov 14 04:54:29 user nova-compute[75469]:     </disk>
Nov 14 04:54:29 user nova-compute[75469]:     <disk name="vda" snapshot="no"/>
Nov 14 04:54:29 user nova-compute[75469]:   </disks>
Nov 14 04:54:29 user nova-compute[75469]: </domainsnapshot>
Nov 14 04:54:29 user nova-compute[75469]:  {{(pid=75469) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.objects.instance [None req-fe562371-5ed3-43d1-aa2b-34cbbb44ba4e tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] Lazy-loading 'system_metadata' on Instance uuid 42daead3-8494-429a-8915-cb88ad87496a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:29 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-fe562371-5ed3-43d1-aa2b-34cbbb44ba4e tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [None req-fe562371-5ed3-43d1-aa2b-34cbbb44ba4e tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a] Traceback (most recent call last):
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     rv = execute(f, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     six.reraise(c, e, tb)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     raise value
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     rv = meth(*args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a] 
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [None req-fe562371-5ed3-43d1-aa2b-34cbbb44ba4e tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a] Traceback (most recent call last):
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     self._volume_snapshot_create(context, instance, guest,
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     rv = execute(f, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     six.reraise(c, e, tb)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     raise value
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     rv = meth(*args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a] 
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-03296dae-7e08-488a-a996-ea61aed17829 tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] [instance: 42daead3-8494-429a-8915-cb88ad87496a] volume_snapshot_delete: delete_info: {'volume_id': 'a316d067-1df3-4ea2-9390-00e967d16429'} {{(pid=75469) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [None req-03296dae-7e08-488a-a996-ea61aed17829 tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a] Traceback (most recent call last):
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a]     if delete_info['type'] != 'qcow2':
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a] KeyError: 'type'
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [instance: 42daead3-8494-429a-8915-cb88ad87496a] 
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [None req-fe562371-5ed3-43d1-aa2b-34cbbb44ba4e tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot d90e7d35-1fe3-455b-8ba0-cc103629c8c2 could not be found.
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver 
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver 
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot d90e7d35-1fe3-455b-8ba0-cc103629c8c2 could not be found. (HTTP 404) (Request-ID: req-4a4f55c5-f69a-4afa-9cd4-0f6c94ab6db7)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver 
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver 
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot d90e7d35-1fe3-455b-8ba0-cc103629c8c2 could not be found.
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver 
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server [None req-fe562371-5ed3-43d1-aa2b-34cbbb44ba4e tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server 
Nov 14 04:54:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver [None req-03296dae-7e08-488a-a996-ea61aed17829 tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver 
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver 
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-742c7dcb-3fb1-4043-8f09-b2c8489b969b)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver 
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver 
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 04:54:29 user nova-compute[75469]: ERROR nova.virt.libvirt.driver 
Nov 14 04:54:29 user nova-compute[75469]: INFO nova.compute.manager [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Terminating instance
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server [None req-03296dae-7e08-488a-a996-ea61aed17829 tempest-VolumesAssistedSnapshotsTest-1744330632 tempest-VolumesAssistedSnapshotsTest-1744330632-project] Exception during message handling: KeyError: 'type'
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 04:54:29 user nova-compute[75469]: ERROR oslo_messaging.rpc.server 
Nov 14 04:54:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 1058013184 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Acquiring lock "42daead3-8494-429a-8915-cb88ad87496a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "42daead3-8494-429a-8915-cb88ad87496a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:29 user nova-compute[75469]: INFO nova.compute.manager [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Detaching volume a316d067-1df3-4ea2-9390-00e967d16429
Nov 14 04:54:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-d1330e1f-4479-4d4d-8b9d-5f3090a2f347 req-5c9f28cb-2c8e-4841-b434-13b35c8a3d53 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1330e1f-4479-4d4d-8b9d-5f3090a2f347 req-5c9f28cb-2c8e-4841-b434-13b35c8a3d53 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1330e1f-4479-4d4d-8b9d-5f3090a2f347 req-5c9f28cb-2c8e-4841-b434-13b35c8a3d53 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1330e1f-4479-4d4d-8b9d-5f3090a2f347 req-5c9f28cb-2c8e-4841-b434-13b35c8a3d53 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-d1330e1f-4479-4d4d-8b9d-5f3090a2f347 req-5c9f28cb-2c8e-4841-b434-13b35c8a3d53 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-unplugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-d1330e1f-4479-4d4d-8b9d-5f3090a2f347 req-5c9f28cb-2c8e-4841-b434-13b35c8a3d53 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:54:29 user nova-compute[75469]: INFO nova.virt.block_device [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Attempting to driver detach volume a316d067-1df3-4ea2-9390-00e967d16429 from mountpoint /dev/vdb
Nov 14 04:54:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Attempting to detach device vdb from instance 42daead3-8494-429a-8915-cb88ad87496a from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 04:54:29 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:29 user nova-compute[75469]:   <source dev="/dev/sdk"/>
Nov 14 04:54:29 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:29 user nova-compute[75469]:   <serial>a316d067-1df3-4ea2-9390-00e967d16429</serial>
Nov 14 04:54:29 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:54:29 user nova-compute[75469]: </disk>
Nov 14 04:54:29 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:29 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Successfully detached device vdb from instance 42daead3-8494-429a-8915-cb88ad87496a from the persistent domain config.
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42daead3-8494-429a-8915-cb88ad87496a from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 04:54:29 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:29 user nova-compute[75469]:   <source dev="/dev/sdk"/>
Nov 14 04:54:29 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:29 user nova-compute[75469]:   <serial>a316d067-1df3-4ea2-9390-00e967d16429</serial>
Nov 14 04:54:29 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:54:29 user nova-compute[75469]: </disk>
Nov 14 04:54:29 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-6590f83e-9fa5-49fa-8934-475b4b77cfae req-019e6e38-0f6c-49d2-874f-56e2ead677b0 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6590f83e-9fa5-49fa-8934-475b4b77cfae req-019e6e38-0f6c-49d2-874f-56e2ead677b0 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6590f83e-9fa5-49fa-8934-475b4b77cfae req-019e6e38-0f6c-49d2-874f-56e2ead677b0 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6590f83e-9fa5-49fa-8934-475b4b77cfae req-019e6e38-0f6c-49d2-874f-56e2ead677b0 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-6590f83e-9fa5-49fa-8934-475b4b77cfae req-019e6e38-0f6c-49d2-874f-56e2ead677b0 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-unplugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-6590f83e-9fa5-49fa-8934-475b4b77cfae req-019e6e38-0f6c-49d2-874f-56e2ead677b0 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42daead3-8494-429a-8915-cb88ad87496a {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdsKPQVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:30 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50496e7-12ee-48ee-9a0f-2a99ee4d0d0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:54:30 user nova-compute[75469]: No targets found.
Nov 14 04:54:30 user nova-compute[75469]: iSNS:
Nov 14 04:54:30 user nova-compute[75469]: No targets found.
Nov 14 04:54:30 user nova-compute[75469]: STATIC:
Nov 14 04:54:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a
Nov 14 04:54:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a
Nov 14 04:54:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201
Nov 14 04:54:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6
Nov 14 04:54:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429
Nov 14 04:54:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31
Nov 14 04:54:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:54:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6
Nov 14 04:54:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417
Nov 14 04:54:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0
Nov 14 04:54:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:30 user nova-compute[75469]: FIRMWARE:
Nov 14 04:54:30 user nova-compute[75469]: No targets found.
Nov 14 04:54:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:54:30 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:54:30 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c06df29-6d63-4aec-b8a3-4740df1726a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.061s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b49567-7d03-4346-9995-6908ab2b3324]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c294c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6'): ({'sdg'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Removing single pathed devices sdg {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df4c3a3-5acf-4857-92ca-a3efc82ce2eb]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2992ef3d-4796-425b-8229-e18eb8330e9d]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Flushing IO for device /dev/sdg {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:54:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Creating image(s)
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Ensure instance console log exists: /opt/stack/data/nova/instances/ccd1b71a-7ecb-4060-bb65-e635222bfcd7/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Start _get_guest_xml network_info=[{"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'bf15a47d-a782-4119-a61d-54af583f17dd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtGiQqMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ccd1b71a-7ecb-4060-bb65-e635222bfcd7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6d71d08-ba53-43c2-955e-526da6f4836d', 'serial': 'b6d71d08-ba53-43c2-955e-526da6f4836d'}, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[86428441-c4a2-49a2-9ebc-302e1e715215]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 04:54:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.objects.instance [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lazy-loading 'vcpu_model' on Instance uuid ccd1b71a-7ecb-4060-bb65-e635222bfcd7 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtGiQqMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:30 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bd54e1-c3db-4f6c-81b0-4ec80f7b587c]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] SCSI volumes sdg have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[39111dd7-7607-471d-a53c-564ea1055496]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[86210a7a-2fdb-4e65-bb4c-25e228317955]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260]
Nov 14 04:54:30 user nova-compute[75469]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057467e-74b7-48df-9c1d-351045bf5c6c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.485s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] <== disconnect_volume: return (486ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.198s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:30 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:30 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fab90e7-3949-4069-9387-7650cb49bb87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:54:30 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c49bed7-33a8-4968-820b-43263b013b7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d] added
Nov 14 04:54:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBtTysoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '1ab6379f-1ffa-4852-a00f-b498b39a2f3d', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb11af0f-eac6-44e1-b526-00487f454c9a', 'serial'} {{(pid=75469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] swap_volume: removing Cinder connection for volume 7579bc3a-c6b8-47b6-a373-20c04568e4b6 {{(pid=75469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b898a2d3-f751-4f13-ae6f-e97574a6c19c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28e9113-8d6c-4fc2-886a-86e9b979c69a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtGiQqMr {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtGiQqMr" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ce69d0-f42a-4104-b837-f66036a85499]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dtGiQqMr'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[376e2019-5a79-420b-8982-55275b95ccd0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dce7c7-c035-4b8b-af2b-17ce6505c011]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:31 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Instance destroyed successfully.
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lazy-loading 'resources' on Instance uuid 4a3ad0cf-02b2-45af-a36e-225a14b972db {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:72:66,bridge_name='br-int',has_traffic_filtering=True,id=0024bc5b-8f80-467c-9e6a-a70926a62b40,network=Network(01981d52-ba0a-40a8-b8b5-7f904317bf41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0024bc5b-8f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:72:66,bridge_name='br-int',has_traffic_filtering=True,id=0024bc5b-8f80-467c-9e6a-a70926a62b40,network=Network(01981d52-ba0a-40a8-b8b5-7f904317bf41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0024bc5b-8f') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0024bc5b-8f, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6cf10d-4133-4371-b708-77e53216391f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260]
Nov 14 04:54:31 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[885993bd-625c-4ca7-91c6-04c095fae784]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[831cb42c-60ab-4347-8dbd-dd2635d53692]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] HCTL ('38', '-', '-', 0) found on session 15 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f26a7d3-b20b-4e6f-b019-ab6775762ac8]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Searching for a device in session 15 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtGiQqMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e59944e-7219-402a-8762-91a872b954ad) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: INFO os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:72:66,bridge_name='br-int',has_traffic_filtering=True,id=0024bc5b-8f80-467c-9e6a-a70926a62b40,network=Network(01981d52-ba0a-40a8-b8b5-7f904317bf41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0024bc5b-8f')
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:f7:b3,bridge_name='br-int',has_traffic_filtering=True,id=ad8ed67d-fc85-46a8-9b0c-c98f73adcf32,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad8ed67d-fc') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:f7:b3,bridge_name='br-int',has_traffic_filtering=True,id=ad8ed67d-fc85-46a8-9b0c-c98f73adcf32,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad8ed67d-fc') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad8ed67d-fc, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4fdc5b8-fdf0-4018-8d7c-da5eefe32886) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: INFO os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:f7:b3,bridge_name='br-int',has_traffic_filtering=True,id=ad8ed67d-fc85-46a8-9b0c-c98f73adcf32,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad8ed67d-fc')
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:87:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f48b6b7-405e-4882-a7a7-85d3f9bbef7b,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f48b6b7-40') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:87:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f48b6b7-405e-4882-a7a7-85d3f9bbef7b,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f48b6b7-40') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f48b6b7-40, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee1426ff-e034-45ce-ad12-562e64ed4c2d) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: INFO os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:87:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f48b6b7-405e-4882-a7a7-85d3f9bbef7b,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f48b6b7-40')
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ee:d5,bridge_name='br-int',has_traffic_filtering=True,id=546edc2c-0c70-40e7-9423-c8d4efb3afd6,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546edc2c-0c') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ee:d5,bridge_name='br-int',has_traffic_filtering=True,id=546edc2c-0c70-40e7-9423-c8d4efb3afd6,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546edc2c-0c') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap546edc2c-0c, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c9e8781-a9e2-4a6f-9f44-93e9cf331017) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: INFO os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ee:d5,bridge_name='br-int',has_traffic_filtering=True,id=546edc2c-0c70-40e7-9423-c8d4efb3afd6,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546edc2c-0c')
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "address": "fa:16:3e:80:6d:38", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df00d8e-ee", "ovs_interfaceid": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "address": "fa:16:3e:80:6d:38", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df00d8e-ee", "ovs_interfaceid": "4df00d8e-ee41-4992-95f8-fa48ac62f211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:6d:38,bridge_name='br-int',has_traffic_filtering=True,id=4df00d8e-ee41-4992-95f8-fa48ac62f211,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df00d8e-ee') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:6d:38,bridge_name='br-int',has_traffic_filtering=True,id=4df00d8e-ee41-4992-95f8-fa48ac62f211,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df00d8e-ee') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4df00d8e-ee, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac9d987a-7e34-476c-b080-ce58a5b7ed6b) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: INFO os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:6d:38,bridge_name='br-int',has_traffic_filtering=True,id=4df00d8e-ee41-4992-95f8-fa48ac62f211,network=Network(90e48339-dcd6-4431-9462-306575237af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df00d8e-ee')
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c2:5e,bridge_name='br-int',has_traffic_filtering=True,id=4e1fdc4b-83d0-4955-bfda-5d8365ba4daf,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1fdc4b-83') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c2:5e,bridge_name='br-int',has_traffic_filtering=True,id=4e1fdc4b-83d0-4955-bfda-5d8365ba4daf,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1fdc4b-83') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e1fdc4b-83, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] swap_volume: Updating volume 7579bc3a-c6b8-47b6-a373-20c04568e4b6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "DBtTysoj", "auth_password": "RF1ocweNMU76hr", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "bb11af0f-eac6-44e1-b526-00487f454c9a"}, "status": "reserved", "instance": "1ab6379f-1ffa-4852-a00f-b498b39a2f3d", "attached_at": "", "detached_at": "", "volume_id": "bb11af0f-eac6-44e1-b526-00487f454c9a", "serial": "bb11af0f-eac6-44e1-b526-00487f454c9a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'bb11af0f-eac6-44e1-b526-00487f454c9a', 'no_device': None, 'attachment_id': 'ac6b92e7-ed20-4ec0-b823-973359690617'} {{(pid=75469) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:31 user nova-compute[75469]: WARNING nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-0024bc5b-8f80-467c-9e6a-a70926a62b40 for instance with vm_state active and task_state deleting.
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-unplugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:31 user nova-compute[75469]: WARNING nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-ad8ed67d-fc85-46a8-9b0c-c98f73adcf32 for instance with vm_state active and task_state deleting.
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-unplugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:31 user nova-compute[75469]: WARNING nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-0f48b6b7-405e-4882-a7a7-85d3f9bbef7b for instance with vm_state active and task_state deleting.
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-unplugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:31 user nova-compute[75469]: WARNING nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-4df00d8e-ee41-4992-95f8-fa48ac62f211 for instance with vm_state active and task_state deleting.
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-unplugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:31 user nova-compute[75469]: WARNING nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf for instance with vm_state active and task_state deleting.
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-unplugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-unplugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:31 user nova-compute[75469]: WARNING nova.compute.manager [req-c4babd8b-05ab-404b-ac48-890e7c3f9ec6 req-9b55a801-068e-4b4a-aac2-c1cf7c5d8528 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-542ff0c0-b25b-43f8-8348-3ae953d8bf8c for instance with vm_state active and task_state deleting.
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab6cc45a-9eb6-47c5-a68c-325520a254cc) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d0394efe-907d-44e8-b2c8-f2253afee09c tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.156s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: INFO os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c2:5e,bridge_name='br-int',has_traffic_filtering=True,id=4e1fdc4b-83d0-4955-bfda-5d8365ba4daf,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1fdc4b-83')
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2144418413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2144418413',id=12,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxPyCGcJBakmOMza6PpRmBv0MGXet1FJcQsZ1G/XnYwJEqD2iFr/kLF0zufYZ8dJ6o/slFvjwTK9xYYdDlb/dQibx2PFK3VlwxtGCQLLW9QCDympfsE4omPxiUYQd1o8g==',key_name='tempest-keypair-383494479',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52720fe9997a4ae787bc1cdd8650eddb',ramdisk_id='',reservation_id='r-f4wh23hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1425625511',owner_user_name='tempest-TaggedBootDevicesTest_v242-1425625511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b98a9566c0b45d68f8d07764e61b385',uuid=4a3ad0cf-02b2-45af-a36e-225a14b972db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converting VIF {"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:2e:27,bridge_name='br-int',has_traffic_filtering=True,id=542ff0c0-b25b-43f8-8348-3ae953d8bf8c,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542ff0c0-b2') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:2e:27,bridge_name='br-int',has_traffic_filtering=True,id=542ff0c0-b25b-43f8-8348-3ae953d8bf8c,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542ff0c0-b2') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap542ff0c0-b2, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3a6c6d4-292b-48b9-9096-5a18a03f12d0) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:31 user nova-compute[75469]: INFO os_vif [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:2e:27,bridge_name='br-int',has_traffic_filtering=True,id=542ff0c0-b25b-43f8-8348-3ae953d8bf8c,network=Network(36469e7a-97a2-47ac-b32f-576338b82984),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542ff0c0-b2')
Nov 14 04:54:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYgvnNZd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:31 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-4583d6b1-fb30-4a01-be25-c020a518fbcf req-4268e92d-89df-41c1-8ed0-e8de367528ef service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-plugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4583d6b1-fb30-4a01-be25-c020a518fbcf req-4268e92d-89df-41c1-8ed0-e8de367528ef service nova] Acquiring lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4583d6b1-fb30-4a01-be25-c020a518fbcf req-4268e92d-89df-41c1-8ed0-e8de367528ef service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4583d6b1-fb30-4a01-be25-c020a518fbcf req-4268e92d-89df-41c1-8ed0-e8de367528ef service nova] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-4583d6b1-fb30-4a01-be25-c020a518fbcf req-4268e92d-89df-41c1-8ed0-e8de367528ef service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] No waiting events found dispatching network-vif-plugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:32 user nova-compute[75469]: WARNING nova.compute.manager [req-4583d6b1-fb30-4a01-be25-c020a518fbcf req-4268e92d-89df-41c1-8ed0-e8de367528ef service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received unexpected event network-vif-plugged-546edc2c-0c70-40e7-9423-c8d4efb3afd6 for instance with vm_state active and task_state deleting.
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] <== connect_volume: return (1660ms) {'type': 'block', 'scsi_wwn': '26666613963383262', 'path': '/dev/sdg'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666613963383262', 'path': '/dev/sdg'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.360s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T04:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-331822876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1029265996',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC0zGU7wJbLcSAC/xTktGHci7HFpvF3FBGGyk0HjgBCCZNw0EArtz9rjG5wJKkYHxC+4AB+HvLzS6vHSWBtNzcZW1BauRPxYSQ65AoHAJP9lrBL9q0UtI4jY1kwja3I9w==',key_name='tempest-keypair-896811283',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb898273020b4563966aedc3204042c8',ramdisk_id='',reservation_id='r-omkk1ohs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-196671126',owner_user_name='tempest-ServerActionsV293TestJSON-196671126-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:54:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='149fe6f4b2584ddb98cce41ca1f943fc',uuid=ccd1b71a-7ecb-4060-bb65-e635222bfcd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converting VIF {"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:54:32 user nova-compute[75469]:   <uuid>ccd1b71a-7ecb-4060-bb65-e635222bfcd7</uuid>
Nov 14 04:54:32 user nova-compute[75469]:   <name>instance-00000007</name>
Nov 14 04:54:32 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:54:32 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:54:32 user nova-compute[75469]:   <metadata>
Nov 14 04:54:32 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:54:32 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:54:32 user nova-compute[75469]:       <nova:name>tempest-ServerActionsV293TestJSON-server-331822876</nova:name>
Nov 14 04:54:32 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:54:30</nova:creationTime>
Nov 14 04:54:32 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:54:32 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:54:32 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:54:32 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:54:32 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:54:32 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:54:32 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:54:32 user nova-compute[75469]:       <nova:owner>
Nov 14 04:54:32 user nova-compute[75469]:         <nova:user uuid="149fe6f4b2584ddb98cce41ca1f943fc">tempest-ServerActionsV293TestJSON-196671126-project-member</nova:user>
Nov 14 04:54:32 user nova-compute[75469]:         <nova:project uuid="bb898273020b4563966aedc3204042c8">tempest-ServerActionsV293TestJSON-196671126</nova:project>
Nov 14 04:54:32 user nova-compute[75469]:       </nova:owner>
Nov 14 04:54:32 user nova-compute[75469]:       <nova:ports>
Nov 14 04:54:32 user nova-compute[75469]:         <nova:port uuid="f7e4eb96-0f42-46e0-a34c-54749e5d33b9">
Nov 14 04:54:32 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 04:54:32 user nova-compute[75469]:         </nova:port>
Nov 14 04:54:32 user nova-compute[75469]:       </nova:ports>
Nov 14 04:54:32 user nova-compute[75469]:     </nova:instance>
Nov 14 04:54:32 user nova-compute[75469]:   </metadata>
Nov 14 04:54:32 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:54:32 user nova-compute[75469]:     <system>
Nov 14 04:54:32 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:54:32 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:54:32 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:54:32 user nova-compute[75469]:       <entry name="serial">ccd1b71a-7ecb-4060-bb65-e635222bfcd7</entry>
Nov 14 04:54:32 user nova-compute[75469]:       <entry name="uuid">ccd1b71a-7ecb-4060-bb65-e635222bfcd7</entry>
Nov 14 04:54:32 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:54:32 user nova-compute[75469]:     </system>
Nov 14 04:54:32 user nova-compute[75469]:   </sysinfo>
Nov 14 04:54:32 user nova-compute[75469]:   <os>
Nov 14 04:54:32 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:54:32 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:54:32 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:54:32 user nova-compute[75469]:   </os>
Nov 14 04:54:32 user nova-compute[75469]:   <features>
Nov 14 04:54:32 user nova-compute[75469]:     <acpi/>
Nov 14 04:54:32 user nova-compute[75469]:     <apic/>
Nov 14 04:54:32 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:54:32 user nova-compute[75469]:   </features>
Nov 14 04:54:32 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:54:32 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:54:32 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:54:32 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:54:32 user nova-compute[75469]:   </clock>
Nov 14 04:54:32 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:54:32 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:54:32 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:54:32 user nova-compute[75469]:   </cpu>
Nov 14 04:54:32 user nova-compute[75469]:   <devices>
Nov 14 04:54:32 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:54:32 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:32 user nova-compute[75469]:       <source dev="/dev/sdg"/>
Nov 14 04:54:32 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:54:32 user nova-compute[75469]:       <serial>b6d71d08-ba53-43c2-955e-526da6f4836d</serial>
Nov 14 04:54:32 user nova-compute[75469]:     </disk>
Nov 14 04:54:32 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:54:32 user nova-compute[75469]:       <mac address="fa:16:3e:9f:e4:9c"/>
Nov 14 04:54:32 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:54:32 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:54:32 user nova-compute[75469]:       <target dev="tapf7e4eb96-0f"/>
Nov 14 04:54:32 user nova-compute[75469]:     </interface>
Nov 14 04:54:32 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:54:32 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/ccd1b71a-7ecb-4060-bb65-e635222bfcd7/console.log" append="off"/>
Nov 14 04:54:32 user nova-compute[75469]:     </serial>
Nov 14 04:54:32 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:54:32 user nova-compute[75469]:     <video>
Nov 14 04:54:32 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:54:32 user nova-compute[75469]:     </video>
Nov 14 04:54:32 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:54:32 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:54:32 user nova-compute[75469]:     </rng>
Nov 14 04:54:32 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:54:32 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:54:32 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:54:32 user nova-compute[75469]:     </memballoon>
Nov 14 04:54:32 user nova-compute[75469]:   </devices>
Nov 14 04:54:32 user nova-compute[75469]: </domain>
Nov 14 04:54:32 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T04:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-331822876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1029265996',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC0zGU7wJbLcSAC/xTktGHci7HFpvF3FBGGyk0HjgBCCZNw0EArtz9rjG5wJKkYHxC+4AB+HvLzS6vHSWBtNzcZW1BauRPxYSQ65AoHAJP9lrBL9q0UtI4jY1kwja3I9w==',key_name='tempest-keypair-896811283',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb898273020b4563966aedc3204042c8',ramdisk_id='',reservation_id='r-omkk1ohs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-196671126',owner_user_name='tempest-ServerActionsV293TestJSON-196671126-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:54:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='149fe6f4b2584ddb98cce41ca1f943fc',uuid=ccd1b71a-7ecb-4060-bb65-e635222bfcd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converting VIF {"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_vif [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4c1e80-cafe-4f96-a52c-46ebfa593c2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:54:32 user nova-compute[75469]: No targets found.
Nov 14 04:54:32 user nova-compute[75469]: iSNS:
Nov 14 04:54:32 user nova-compute[75469]: No targets found.
Nov 14 04:54:32 user nova-compute[75469]: STATIC:
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: FIRMWARE:
Nov 14 04:54:32 user nova-compute[75469]: No targets found.
Nov 14 04:54:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:54:32 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:54:32 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '974c48b7-53a3-5290-93ee-7fe530c2d746', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7e4eb96-0f, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7e4eb96-0f, col_values=(('qos', UUID('913b713f-45f7-4768-97bc-fd20a4b4522c')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7e4eb96-0f, col_values=(('external_ids', {'iface-id': 'f7e4eb96-0f42-46e0-a34c-54749e5d33b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:e4:9c', 'vm-uuid': 'ccd1b71a-7ecb-4060-bb65-e635222bfcd7'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e30c0c-eb75-4d91-ba84-e42141f65395]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:32 user nova-compute[75469]: INFO os_vif [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f')
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d067cb7f-8323-46ba-8e2a-77dca7b00a9d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c27af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a'): ({'sdc'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Removing single pathed devices sdc {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] No VIF found with MAC fa:16:3e:9f:e4:9c, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1c55c2-fffc-4e4b-a7cd-652fde5faf5b]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[473ed18f-aef3-4ec3-8608-faa634af6233]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Flushing IO for device /dev/sdc {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d4fd41-5311-4dd2-9c25-1fa6af3f5f9e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f976d099-3041-4b93-bfec-acf20a3c164c]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] SCSI volumes sdc have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0955c127-fc90-41f0-b479-3a64fd835e87]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.utils [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8367ba9b-5641-4a03-98b0-ca4bcb6abdab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8861b95a-41fb-4c72-bae2-aff2f6c21a87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad04b8f6-fb9f-4034-bf33-3a689a02cd79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[155287a9-66fc-4d21-9746-34ee3dec6bd8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b61486-a75e-4826-9790-44c75a8cc6f6]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a, portal: 172.16.0.220,3260]
Nov 14 04:54:32 user nova-compute[75469]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:32 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62fe025-409f-4604-9dcd-d599ee64d4da]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.utils [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f289f6-355c-4bfb-803a-53b00ab7001a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c294289c-abbb-45e7-86f8-a29787270cf7]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] <== disconnect_volume: return (775ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGinBDhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:32 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5f9acf-b2ca-4441-bd15-2f11136da9ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:54:32 user nova-compute[75469]: No targets found.
Nov 14 04:54:32 user nova-compute[75469]: iSNS:
Nov 14 04:54:32 user nova-compute[75469]: No targets found.
Nov 14 04:54:32 user nova-compute[75469]: STATIC:
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0
Nov 14 04:54:32 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:32 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:32 user nova-compute[75469]: FIRMWARE:
Nov 14 04:54:32 user nova-compute[75469]: No targets found.
Nov 14 04:54:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:54:32 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:54:32 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7101098-2865-4d54-8ce1-a9fb0edb8470]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: INFO nova.compute.manager [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Swapping volume bb11af0f-eac6-44e1-b526-00487f454c9a for 7579bc3a-c6b8-47b6-a373-20c04568e4b6
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bb70a8-02b5-423c-b100-8ca2f8fd8fff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c27a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31'): ({'sdd'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Removing single pathed devices sdd {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5993cb5f-9a9f-47cd-8c73-5fe1ef21761a]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0faef65d-62e0-4d48-92d5-f50395b7d190 is timed out.
Nov 14 04:54:32 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Successfully detached device vdb from instance 0faef65d-62e0-4d48-92d5-f50395b7d190 from the live domain config.
Nov 14 04:54:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKXywQFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:32 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfffbca-181e-42b3-9a35-6cbc9cb7e9dd]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Flushing IO for device /dev/sdd {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13f1ae3-7b44-4026-a668-ff8948ce601e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dab082-dade-4d34-9d1c-203c975ffc91]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6f277c-f29a-4c26-8c4f-aa39d1427392]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bec2d97-8533-4bc8-887a-a5a7211ee660]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31, portal: 172.16.0.220,3260]
Nov 14 04:54:32 user nova-compute[75469]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6f32eb-833c-4a72-bea8-cbfa5ad92c31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[858156a8-d0b8-48f8-b77a-140713a68247]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] <== disconnect_volume: return (335ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.201s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjaTXBWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:33 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd2ad4b-03c4-4ea3-bc22-9510a601238f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:54:33 user nova-compute[75469]: No targets found.
Nov 14 04:54:33 user nova-compute[75469]: iSNS:
Nov 14 04:54:33 user nova-compute[75469]: No targets found.
Nov 14 04:54:33 user nova-compute[75469]: STATIC:
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: FIRMWARE:
Nov 14 04:54:33 user nova-compute[75469]: No targets found.
Nov 14 04:54:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:54:33 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:54:33 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3427e9-92b5-473b-9706-75969f6ba023]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5411394f-41a7-4a05-8ac3-2394937ef250]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c726290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84110e5-7d7e-426e-aa08-469fbf6fba3b]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[16857d11-2748-4c10-a288-f7f31d1b1577]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba43485-cc1b-46d7-a90e-5f404271dbd3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e254a364-eb86-4d48-8872-0900d5cb23c5]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca4fbcf-19b5-4839-a754-da4f215fd08b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b690e4d3-c48f-4675-86f5-f8e584273a19]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201, portal: 172.16.0.220,3260]
Nov 14 04:54:33 user nova-compute[75469]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89680ce7-14a8-4fb8-a9ee-993031641201 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[327220c7-a8ee-4b7e-9977-ddc6bfe73b69]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] <== disconnect_volume: return (533ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.334s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c0a4a4-c377-43de-abf4-e220b99640ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:54:33 user nova-compute[75469]: No targets found.
Nov 14 04:54:33 user nova-compute[75469]: iSNS:
Nov 14 04:54:33 user nova-compute[75469]: No targets found.
Nov 14 04:54:33 user nova-compute[75469]: STATIC:
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0
Nov 14 04:54:33 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:33 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:33 user nova-compute[75469]: FIRMWARE:
Nov 14 04:54:33 user nova-compute[75469]: No targets found.
Nov 14 04:54:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:54:33 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:54:33 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69b4531-c6cd-4ede-b53d-a60e4279196c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ad6fe2-2a46-47f1-80b9-36e304fa5cc1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f640d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417'): ({'sde'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Removing single pathed devices sde {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8875324-a5d2-4420-ae08-6544c3e2f68b]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b34e8f-b0fc-4588-b32d-d441a570cf3b]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Flushing IO for device /dev/sde {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[28635afc-1bb0-49c2-89f0-15dc3d719e09]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[223a370b-3148-411b-bb28-016c77d1951e]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6af13d-96cb-4012-94e8-ba1c4af27472]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47869a1-c387-4752-9b25-969a48354e7e]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417, portal: 172.16.0.220,3260]
Nov 14 04:54:33 user nova-compute[75469]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132a3528-2b47-42b8-abb6-1885c17b7417 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bffd7d8-b7e2-4230-90d6-fd0ff02c6b24]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] <== disconnect_volume: return (684ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:54:33 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Deleting instance files /opt/stack/data/nova/instances/4a3ad0cf-02b2-45af-a36e-225a14b972db_del
Nov 14 04:54:33 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Deletion of /opt/stack/data/nova/instances/4a3ad0cf-02b2-45af-a36e-225a14b972db_del complete
Nov 14 04:54:33 user nova-compute[75469]: INFO nova.compute.manager [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Took 4.46 seconds to destroy the instance on the hypervisor.
Nov 14 04:54:33 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:54:33 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG nova.objects.instance [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lazy-loading 'flavor' on Instance uuid 0faef65d-62e0-4d48-92d5-f50395b7d190 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] No waiting events found dispatching network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:34 user nova-compute[75469]: WARNING nova.compute.manager [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received unexpected event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 04:54:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] No waiting events found dispatching network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:34 user nova-compute[75469]: WARNING nova.compute.manager [req-8218fd50-1889-4c74-8ca7-13d9e5f4e077 req-8b98a882-dd27-4148-8404-2430e3021525 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received unexpected event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 04:54:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-942b666d-53f9-4a91-a745-20d46c6b03fd tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.102s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.compute.manager [req-bb09b536-d1a2-47e8-8d74-6e0f9d506ca2 req-ef4e7953-65d1-4cc6-927e-6a06a38bc440 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-deleted-4df00d8e-ee41-4992-95f8-fa48ac62f211 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:35 user nova-compute[75469]: INFO nova.compute.manager [req-bb09b536-d1a2-47e8-8d74-6e0f9d506ca2 req-ef4e7953-65d1-4cc6-927e-6a06a38bc440 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Neutron deleted interface 4df00d8e-ee41-4992-95f8-fa48ac62f211; detaching it from the instance and deleting it from the info cache
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.network.neutron [req-bb09b536-d1a2-47e8-8d74-6e0f9d506ca2 req-ef4e7953-65d1-4cc6-927e-6a06a38bc440 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating instance_info_cache with network_info: [{"id": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "address": "fa:16:3e:1b:72:66", "network": {"id": "01981d52-ba0a-40a8-b8b5-7f904317bf41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-591355324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0024bc5b-8f", "ovs_interfaceid": "0024bc5b-8f80-467c-9e6a-a70926a62b40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "address": "fa:16:3e:75:f7:b3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8ed67d-fc", "ovs_interfaceid": "ad8ed67d-fc85-46a8-9b0c-c98f73adcf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "address": "fa:16:3e:0e:87:a3", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f48b6b7-40", "ovs_interfaceid": "0f48b6b7-405e-4882-a7a7-85d3f9bbef7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "address": "fa:16:3e:98:ee:d5", "network": {"id": "90e48339-dcd6-4431-9462-306575237af9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1270977027", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546edc2c-0c", "ovs_interfaceid": "546edc2c-0c70-40e7-9423-c8d4efb3afd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "address": "fa:16:3e:51:c2:5e", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1fdc4b-83", "ovs_interfaceid": "4e1fdc4b-83d0-4955-bfda-5d8365ba4daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "address": "fa:16:3e:66:2e:27", "network": {"id": "36469e7a-97a2-47ac-b32f-576338b82984", "bridge": "br-int", "label": "tempest-device-tagging-net2-459708953", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52720fe9997a4ae787bc1cdd8650eddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542ff0c0-b2", "ovs_interfaceid": "542ff0c0-b25b-43f8-8348-3ae953d8bf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.compute.manager [req-bb09b536-d1a2-47e8-8d74-6e0f9d506ca2 req-ef4e7953-65d1-4cc6-927e-6a06a38bc440 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Detach interface failed, port_id=4df00d8e-ee41-4992-95f8-fa48ac62f211, reason: Instance 4a3ad0cf-02b2-45af-a36e-225a14b972db could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.compute.manager [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:54:35 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Instance spawned successfully.
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.compute.manager [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:35 user nova-compute[75469]: DEBUG nova.objects.instance [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75469) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 04:54:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c56dfbc1-26dd-4dca-aac8-cd26a4377136 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.090s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:37 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Took 3.65 seconds to deallocate network for instance.
Nov 14 04:54:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdsKPQVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ab6379f-1ffa-4852-a00f-b498b39a2f3d', 'attached_at': '', 'detached_at': '', 'volume_id': '7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'serial': '7579bc3a-c6b8-47b6-a373-20c04568e4b6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBtTysoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'bb11af0f-eac6-44e1-b526-00487f454c9a'}, 'status': 'reserved', 'instance': '1ab6379f-1ffa-4852-a00f-b498b39a2f3d', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb11af0f-eac6-44e1-b526-00487f454c9a', 'serial'} {{(pid=75469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdsKPQVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:37 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:37 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:37 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[162dbfe3-bcec-4980-aca4-3554a2685dde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:54:37 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11d92b2-cbc8-426e-958a-c6ce33d80a85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6] added
Nov 14 04:54:37 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[706c2f47-3f15-4046-b51f-94abde552da5]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0178c1fc-103e-4a24-a7ec-fbbf41d30f50]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdsKPQVS {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdsKPQVS" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9c1ab1-ffa4-4f12-9fad-660fa11580c8]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xdsKPQVS'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6061d40-6a8c-410f-b0d7-c4f0c10d9c3f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cebac77-59a0-461d-9723-aeebdf3a99ec]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae267e27-2f11-45a6-a59a-2c445841440f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260]
Nov 14 04:54:37 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:37 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[610995cf-39ec-48e2-9c8f-33ab1bfc8890]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-f4e6d07f-82e6-45fb-a325-9be703a2abb0 req-9aa3e95c-2bd3-4b4b-a758-0330bfc1f6e3 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-deleted-4e1fdc4b-83d0-4955-bfda-5d8365ba4daf {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-f4e6d07f-82e6-45fb-a325-9be703a2abb0 req-9aa3e95c-2bd3-4b4b-a758-0330bfc1f6e3 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-deleted-542ff0c0-b25b-43f8-8348-3ae953d8bf8c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-f4e6d07f-82e6-45fb-a325-9be703a2abb0 req-9aa3e95c-2bd3-4b4b-a758-0330bfc1f6e3 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-deleted-0024bc5b-8f80-467c-9e6a-a70926a62b40 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-f4e6d07f-82e6-45fb-a325-9be703a2abb0 req-9aa3e95c-2bd3-4b4b-a758-0330bfc1f6e3 service nova] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Received event network-vif-deleted-546edc2c-0c70-40e7-9423-c8d4efb3afd6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[247c01c0-dc0c-4b6a-8771-2cd9fa3399e7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:37 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5665be7b-d503-4cf8-b66e-f35707ce236b]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:37 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:54:38 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:54:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdsKPQVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:54:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23464386530663332', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464386530663332', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:54:38 user nova-compute[75469]: DEBUG nova.objects.instance [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lazy-loading 'flavor' on Instance uuid 1ab6379f-1ffa-4852-a00f-b498b39a2f3d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 56623104 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:40 user nova-compute[75469]: INFO nova.compute.manager [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] [instance: 4a3ad0cf-02b2-45af-a36e-225a14b972db] Took 2.53 seconds to detach 3 volumes for instance.
Nov 14 04:54:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 108003328 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:40 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:54:40 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:54:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:40 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Deleted allocations for instance 4a3ad0cf-02b2-45af-a36e-225a14b972db
Nov 14 04:54:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 272629760 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffd3f251-8a1a-46d4-83b8-7e90ad4a6926 tempest-TaggedBootDevicesTest_v242-1425625511 tempest-TaggedBootDevicesTest_v242-1425625511-project-member] Lock "4a3ad0cf-02b2-45af-a36e-225a14b972db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.583s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:41 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 375390208 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:41 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 555745280 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:42 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 737148928 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:42 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 909115392 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 1066401792 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:54:43 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 071f97b4-296b-43aa-8fa9-cf0a69c9764d is timed out.
Nov 14 04:54:43 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Successfully detached device sdc from instance 071f97b4-296b-43aa-8fa9-cf0a69c9764d from the live domain config.
Nov 14 04:54:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'covbPnSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:43 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7573e921-f5bb-40ec-a76c-899c5c4f0c9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:54:43 user nova-compute[75469]: No targets found.
Nov 14 04:54:43 user nova-compute[75469]: iSNS:
Nov 14 04:54:43 user nova-compute[75469]: No targets found.
Nov 14 04:54:43 user nova-compute[75469]: STATIC:
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: FIRMWARE:
Nov 14 04:54:43 user nova-compute[75469]: No targets found.
Nov 14 04:54:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:54:43 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:54:43 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea103b8-58cd-4301-bb58-0619e4b8e8c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e704b8-89e0-4e88-9a74-c7e8e9380b96]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:43 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa758f8fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0'): ({'sdi'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Removing single pathed devices sdi {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1167f04-e932-4b52-9622-48b7f4923606]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f792a461-0d13-4895-8ded-c05ebe803af9]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Flushing IO for device /dev/sdi {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bf8c47-d810-4c68-a926-6feadb743b1b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.036s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a0f4b7-0cd7-4fd8-92d0-50dffa1a88ee]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] SCSI volumes sdi have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76db075-3719-407c-b375-d81a31af7d47]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updating instance_info_cache with network_info: [{"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a22152-7c93-4c5c-8bc2-5a51773da932]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0, portal: 172.16.0.220,3260]
Nov 14 04:54:43 user nova-compute[75469]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b848f1-0aae-4f3d-b9bb-83f0266e14f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[654d6622-155b-438c-9049-f2e117cbd404]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] <== disconnect_volume: return (387ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBtTysoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'bb11af0f-eac6-44e1-b526-00487f454c9a'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:43 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f24ea7-a7ba-4880-8735-e36f18613715]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:54:43 user nova-compute[75469]: No targets found.
Nov 14 04:54:43 user nova-compute[75469]: iSNS:
Nov 14 04:54:43 user nova-compute[75469]: No targets found.
Nov 14 04:54:43 user nova-compute[75469]: STATIC:
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6
Nov 14 04:54:43 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:43 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:43 user nova-compute[75469]: FIRMWARE:
Nov 14 04:54:43 user nova-compute[75469]: No targets found.
Nov 14 04:54:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:54:43 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:54:43 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4266eb7-2209-42f4-89a8-692c4782a9d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e1a8e4-6eca-4e4a-ab0c-771b515017e8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c296b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a'): ({'sdh'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Removing single pathed devices sdh {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b47b73a-9dd4-4bf6-b1e3-41e67b65064a]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e6d131-7c02-4b90-85a0-b2b7589b052b]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Flushing IO for device /dev/sdh {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[377bd5b1-998a-4129-914a-29c97ca4bbf1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc1c77d-11bc-4b13-b130-34c4a54697de]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] SCSI volumes sdh have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[da02fb0a-a15d-48b2-8c48-689510350fdc]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6066b73-78e8-4c1a-afb5-9479e4c57e34]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a, portal: 172.16.0.220,3260]
Nov 14 04:54:44 user nova-compute[75469]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb11af0f-eac6-44e1-b526-00487f454c9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8517c7-4753-460a-9369-68a93fc37e1e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] <== disconnect_volume: return (338ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdsKPQVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1ab6379f-1ffa-4852-a00f-b498b39a2f3d', 'attached_at': '', 'detached_at': '', 'volume_id': '7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'serial'} {{(pid=75469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] swap_volume: removing Cinder connection for volume bb11af0f-eac6-44e1-b526-00487f454c9a {{(pid=75469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 04:54:44 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c32dcf16-daa4-4370-be69-ebeba12e2b12 is timed out.
Nov 14 04:54:44 user nova-compute[75469]: DEBUG nova.objects.instance [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lazy-loading 'flavor' on Instance uuid 071f97b4-296b-43aa-8fa9-cf0a69c9764d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:44 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Successfully detached device vdb from instance c32dcf16-daa4-4370-be69-ebeba12e2b12 from the live domain config.
Nov 14 04:54:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COqKaSLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:44 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e81908d-04c5-43e3-a6e0-be2fb21e2043]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:54:44 user nova-compute[75469]: No targets found.
Nov 14 04:54:44 user nova-compute[75469]: iSNS:
Nov 14 04:54:44 user nova-compute[75469]: No targets found.
Nov 14 04:54:44 user nova-compute[75469]: STATIC:
Nov 14 04:54:44 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:54:44 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:44 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:44 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6
Nov 14 04:54:44 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:44 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:44 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429
Nov 14 04:54:44 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:44 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:44 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:54:44 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:44 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:44 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6
Nov 14 04:54:44 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:44 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:44 user nova-compute[75469]: FIRMWARE:
Nov 14 04:54:44 user nova-compute[75469]: No targets found.
Nov 14 04:54:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:54:44 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:54:44 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-54afbac2-d7c4-45bf-b54f-86edddce164f tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.009s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0236cb-200d-4a8b-922b-acbb0c4713c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[573f7ca5-1fde-4692-ba2a-c2ea9698fea4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c65dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6'): ({'sdj'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Removing single pathed devices sdj {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f8ca94-cfb2-4662-96bd-1fb63c2703c3]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70f6437-f80d-4e75-855b-dcb5d473f735]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Flushing IO for device /dev/sdj {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[550449c5-bdb4-4aa8-863b-7d424f9ae4f4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d3bc11-dba5-49ff-a2f8-942669fd62a5]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] SCSI volumes sdj have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] swap_volume: Updating volume bb11af0f-eac6-44e1-b526-00487f454c9a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "xdsKPQVS", "auth_password": "WizKjqcQ2ta1gX", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "7579bc3a-c6b8-47b6-a373-20c04568e4b6"}, "status": "reserved", "instance": "1ab6379f-1ffa-4852-a00f-b498b39a2f3d", "attached_at": "", "detached_at": "", "volume_id": "7579bc3a-c6b8-47b6-a373-20c04568e4b6", "serial": "7579bc3a-c6b8-47b6-a373-20c04568e4b6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'no_device': None, 'attachment_id': '1d7e67f0-caf9-4dcb-96c2-e6dac87efa51'} {{(pid=75469) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a33233-9096-45e4-b1ba-833f7b07c3b1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c878fa01-a877-4c98-83e8-4dc173298f2a tempest-TestVolumeSwap-401111779 tempest-TestVolumeSwap-401111779-project-admin] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.739s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2e070e-0e93-462a-9725-85c7240d947b]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6, portal: 172.16.0.220,3260]
Nov 14 04:54:45 user nova-compute[75469]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe2b2d7-f4be-4950-aac6-fcc11e2d97a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7590bb-1404-46be-adf7-f45eccd55b76]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] <== disconnect_volume: return (462ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:46 user nova-compute[75469]: INFO nova.compute.manager [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Terminating instance
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:54:46 user nova-compute[75469]: INFO nova.compute.manager [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Detaching volume 7579bc3a-c6b8-47b6-a373-20c04568e4b6
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lazy-loading 'flavor' on Instance uuid c32dcf16-daa4-4370-be69-ebeba12e2b12 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:46 user nova-compute[75469]: INFO nova.virt.block_device [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Attempting to driver detach volume 7579bc3a-c6b8-47b6-a373-20c04568e4b6 from mountpoint /dev/vdb
Nov 14 04:54:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Attempting to detach device vdb from instance 1ab6379f-1ffa-4852-a00f-b498b39a2f3d from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:54:46 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:46 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 04:54:46 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:46 user nova-compute[75469]:   <serial>7579bc3a-c6b8-47b6-a373-20c04568e4b6</serial>
Nov 14 04:54:46 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:54:46 user nova-compute[75469]: </disk>
Nov 14 04:54:46 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:54:46 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Successfully detached device vdb from instance 1ab6379f-1ffa-4852-a00f-b498b39a2f3d from the persistent domain config.
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ab6379f-1ffa-4852-a00f-b498b39a2f3d from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:54:46 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:54:46 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 04:54:46 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:54:46 user nova-compute[75469]:   <serial>7579bc3a-c6b8-47b6-a373-20c04568e4b6</serial>
Nov 14 04:54:46 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:54:46 user nova-compute[75469]: </disk>
Nov 14 04:54:46 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8082977e-460f-4eee-a201-d9e7c426a532 tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.028s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-1ca5be39-e25a-47ad-832d-3e333b223287 req-813d579b-2557-4e50-a098-8631fa95b3a7 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Received event network-vif-unplugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1ca5be39-e25a-47ad-832d-3e333b223287 req-813d579b-2557-4e50-a098-8631fa95b3a7 service nova] Acquiring lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1ca5be39-e25a-47ad-832d-3e333b223287 req-813d579b-2557-4e50-a098-8631fa95b3a7 service nova] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1ca5be39-e25a-47ad-832d-3e333b223287 req-813d579b-2557-4e50-a098-8631fa95b3a7 service nova] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-1ca5be39-e25a-47ad-832d-3e333b223287 req-813d579b-2557-4e50-a098-8631fa95b3a7 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] No waiting events found dispatching network-vif-unplugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-1ca5be39-e25a-47ad-832d-3e333b223287 req-813d579b-2557-4e50-a098-8631fa95b3a7 service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Received event network-vif-unplugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ab6379f-1ffa-4852-a00f-b498b39a2f3d {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "interface-c32dcf16-daa4-4370-be69-ebeba12e2b12-079c1d45-5dc2-493b-b3cd-27433bb99386" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "interface-c32dcf16-daa4-4370-be69-ebeba12e2b12-079c1d45-5dc2-493b-b3cd-27433bb99386" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:47 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Instance destroyed successfully.
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lazy-loading 'resources' on Instance uuid 071f97b4-296b-43aa-8fa9-cf0a69c9764d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lazy-loading 'flavor' on Instance uuid c32dcf16-daa4-4370-be69-ebeba12e2b12 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-347133932',display_name='tempest-AttachSCSIVolumeTestJSON-server-347133932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-347133932',id=9,image_ref='2372ddfc-76a1-42de-b11b-2aeeccfffbb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPmEDao1Vq9rnMu3Ihnzex39gY31OtW0AM194OCxUvM1vc2XGNh1iiP88VMfCs5omiQf6MblTQ0meGETZDc/4TZw7Pqbt05OiZg5yqbSrJ2rK21U3hGFKsTrBFzWUIQ2A==',key_name='tempest-keypair-1133741573',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84e416fb9684a249adb4fca64d871e4',ramdisk_id='',reservation_id='r-4ns8c5b9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2372ddfc-76a1-42de-b11b-2aeeccfffbb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-745995412',owner_user_name='tempest-AttachSCSIVolumeTestJSON-745995412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f44394442ce34cda9a0f4f4d17fab163',uuid=071f97b4-296b-43aa-8fa9-cf0a69c9764d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "address": "fa:16:3e:13:c1:05", "network": {"id": "daa70d61-704e-4a88-ab73-98f56391d1f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-839348841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84e416fb9684a249adb4fca64d871e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa599f35-2b", "ovs_interfaceid": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Converting VIF {"id": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "address": "fa:16:3e:13:c1:05", "network": {"id": "daa70d61-704e-4a88-ab73-98f56391d1f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-839348841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84e416fb9684a249adb4fca64d871e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa599f35-2b", "ovs_interfaceid": "aa599f35-2b08-4d29-9b68-fecf5f4fcaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:c1:05,bridge_name='br-int',has_traffic_filtering=True,id=aa599f35-2b08-4d29-9b68-fecf5f4fcaa8,network=Network(daa70d61-704e-4a88-ab73-98f56391d1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa599f35-2b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG os_vif [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:c1:05,bridge_name='br-int',has_traffic_filtering=True,id=aa599f35-2b08-4d29-9b68-fecf5f4fcaa8,network=Network(daa70d61-704e-4a88-ab73-98f56391d1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa599f35-2b') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa599f35-2b, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-4526189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-4526189',id=10,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO++5P4KL/ZlD2ZzykOgGS1QHT6rp4SrhnI8T9uGc2ieskb1Zpm1kRlcju/ARTYmnDKlMLY/nhtyrzPX47AoyAGkHDc3X9h1UXq82L6/7cPAy7R2c05pO9fh3r7p59j+EA==',key_name='tempest-keypair-1149227935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cab74b837d742b2bf746eaf0f8a8d5f',ramdisk_id='',reservation_id='r-r4mmdsm7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1158979709',owner_user_name='tempest-TaggedAttachmentsTest-1158979709-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4371d2e15d6486b8b6aafd72905b1e5',uuid=c32dcf16-daa4-4370-be69-ebeba12e2b12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "079c1d45-5dc2-493b-b3cd-27433bb99386", "address": "fa:16:3e:47:84:56", "network": {"id": "53b318a2-3540-4714-95db-1e1a1ccaf111", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1699408991", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079c1d45-5d", "ovs_interfaceid": "079c1d45-5dc2-493b-b3cd-27433bb99386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converting VIF {"id": "079c1d45-5dc2-493b-b3cd-27433bb99386", "address": "fa:16:3e:47:84:56", "network": {"id": "53b318a2-3540-4714-95db-1e1a1ccaf111", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1699408991", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079c1d45-5d", "ovs_interfaceid": "079c1d45-5dc2-493b-b3cd-27433bb99386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:84:56,bridge_name='br-int',has_traffic_filtering=True,id=079c1d45-5dc2-493b-b3cd-27433bb99386,network=Network(53b318a2-3540-4714-95db-1e1a1ccaf111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079c1d45-5d') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2acd4dda-02dc-4dbc-b3fb-c83456abf2d4) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:84:56"/><model type="virtio"/><mtu size="1442"/><target dev="tap079c1d45-5d"/></interface> {{(pid=75469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:84:56"/><model type="virtio"/><mtu size="1442"/><target dev="tap079c1d45-5d"/></interface> {{(pid=75469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Attempting to detach device tap079c1d45-5d from instance c32dcf16-daa4-4370-be69-ebeba12e2b12 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] detach device xml: <interface type="ethernet">
Nov 14 04:54:47 user nova-compute[75469]:   <mac address="fa:16:3e:47:84:56"/>
Nov 14 04:54:47 user nova-compute[75469]:   <model type="virtio"/>
Nov 14 04:54:47 user nova-compute[75469]:   <mtu size="1442"/>
Nov 14 04:54:47 user nova-compute[75469]:   <target dev="tap079c1d45-5d"/>
Nov 14 04:54:47 user nova-compute[75469]: </interface>
Nov 14 04:54:47 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:47 user nova-compute[75469]: INFO os_vif [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:c1:05,bridge_name='br-int',has_traffic_filtering=True,id=aa599f35-2b08-4d29-9b68-fecf5f4fcaa8,network=Network(daa70d61-704e-4a88-ab73-98f56391d1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa599f35-2b')
Nov 14 04:54:47 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Deleting instance files /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d_del
Nov 14 04:54:47 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Deletion of /opt/stack/data/nova/instances/071f97b4-296b-43aa-8fa9-cf0a69c9764d_del complete
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:84:56"/><model type="virtio"/><mtu size="1442"/><target dev="tap079c1d45-5d"/></interface> {{(pid=75469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:84:56"/><model type="virtio"/><mtu size="1442"/><target dev="tap079c1d45-5d"/></interface>not found in domain: <domain type='kvm' id='10'>
Nov 14 04:54:47 user nova-compute[75469]:   <name>instance-0000000a</name>
Nov 14 04:54:47 user nova-compute[75469]:   <uuid>c32dcf16-daa4-4370-be69-ebeba12e2b12</uuid>
Nov 14 04:54:47 user nova-compute[75469]:   <metadata>
Nov 14 04:54:47 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:54:47 user nova-compute[75469]:   <nova:package version="0.0.0"/>
Nov 14 04:54:47 user nova-compute[75469]:   <nova:name>tempest-device-tagging-server-4526189</nova:name>
Nov 14 04:54:47 user nova-compute[75469]:   <nova:creationTime>2023-11-14 04:54:15</nova:creationTime>
Nov 14 04:54:47 user nova-compute[75469]:   <nova:flavor name="m1.tiny">
Nov 14 04:54:47 user nova-compute[75469]:     <nova:memory>512</nova:memory>
Nov 14 04:54:47 user nova-compute[75469]:     <nova:disk>1</nova:disk>
Nov 14 04:54:47 user nova-compute[75469]:     <nova:swap>0</nova:swap>
Nov 14 04:54:47 user nova-compute[75469]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:54:47 user nova-compute[75469]:     <nova:vcpus>1</nova:vcpus>
Nov 14 04:54:47 user nova-compute[75469]:   </nova:flavor>
Nov 14 04:54:47 user nova-compute[75469]:   <nova:owner>
Nov 14 04:54:47 user nova-compute[75469]:     <nova:user uuid="c4371d2e15d6486b8b6aafd72905b1e5">tempest-TaggedAttachmentsTest-1158979709-project-member</nova:user>
Nov 14 04:54:47 user nova-compute[75469]:     <nova:project uuid="4cab74b837d742b2bf746eaf0f8a8d5f">tempest-TaggedAttachmentsTest-1158979709</nova:project>
Nov 14 04:54:47 user nova-compute[75469]:   </nova:owner>
Nov 14 04:54:47 user nova-compute[75469]:   <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:54:47 user nova-compute[75469]:   <nova:ports>
Nov 14 04:54:47 user nova-compute[75469]:     <nova:port uuid="a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f">
Nov 14 04:54:47 user nova-compute[75469]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 04:54:47 user nova-compute[75469]:     </nova:port>
Nov 14 04:54:47 user nova-compute[75469]:     <nova:port uuid="079c1d45-5dc2-493b-b3cd-27433bb99386">
Nov 14 04:54:47 user nova-compute[75469]:       <nova:ip type="fixed" address="10.10.10.8" ipVersion="4"/>
Nov 14 04:54:47 user nova-compute[75469]:     </nova:port>
Nov 14 04:54:47 user nova-compute[75469]:   </nova:ports>
Nov 14 04:54:47 user nova-compute[75469]: </nova:instance>
Nov 14 04:54:47 user nova-compute[75469]:   </metadata>
Nov 14 04:54:47 user nova-compute[75469]:   <memory unit='KiB'>524288</memory>
Nov 14 04:54:47 user nova-compute[75469]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 04:54:47 user nova-compute[75469]:   <vcpu placement='static'>1</vcpu>
Nov 14 04:54:47 user nova-compute[75469]:   <resource>
Nov 14 04:54:47 user nova-compute[75469]:     <partition>/machine</partition>
Nov 14 04:54:47 user nova-compute[75469]:   </resource>
Nov 14 04:54:47 user nova-compute[75469]:   <sysinfo type='smbios'>
Nov 14 04:54:47 user nova-compute[75469]:     <system>
Nov 14 04:54:47 user nova-compute[75469]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 04:54:47 user nova-compute[75469]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 04:54:47 user nova-compute[75469]:       <entry name='version'>0.0.0</entry>
Nov 14 04:54:47 user nova-compute[75469]:       <entry name='serial'>c32dcf16-daa4-4370-be69-ebeba12e2b12</entry>
Nov 14 04:54:47 user nova-compute[75469]:       <entry name='uuid'>c32dcf16-daa4-4370-be69-ebeba12e2b12</entry>
Nov 14 04:54:47 user nova-compute[75469]:       <entry name='family'>Virtual Machine</entry>
Nov 14 04:54:47 user nova-compute[75469]:     </system>
Nov 14 04:54:47 user nova-compute[75469]:   </sysinfo>
Nov 14 04:54:47 user nova-compute[75469]:   <os>
Nov 14 04:54:47 user nova-compute[75469]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 04:54:47 user nova-compute[75469]:     <boot dev='hd'/>
Nov 14 04:54:47 user nova-compute[75469]:     <smbios mode='sysinfo'/>
Nov 14 04:54:47 user nova-compute[75469]:   </os>
Nov 14 04:54:47 user nova-compute[75469]:   <features>
Nov 14 04:54:47 user nova-compute[75469]:     <acpi/>
Nov 14 04:54:47 user nova-compute[75469]:     <apic/>
Nov 14 04:54:47 user nova-compute[75469]:     <vmcoreinfo state='on'/>
Nov 14 04:54:47 user nova-compute[75469]:   </features>
Nov 14 04:54:47 user nova-compute[75469]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 04:54:47 user nova-compute[75469]:     <model fallback='forbid'>Nehalem</model>
Nov 14 04:54:47 user nova-compute[75469]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 04:54:47 user nova-compute[75469]:     <feature policy='require' name='vme'/>
Nov 14 04:54:47 user nova-compute[75469]:     <feature policy='require' name='x2apic'/>
Nov 14 04:54:47 user nova-compute[75469]:     <feature policy='require' name='hypervisor'/>
Nov 14 04:54:47 user nova-compute[75469]:   </cpu>
Nov 14 04:54:47 user nova-compute[75469]:   <clock offset='utc'>
Nov 14 04:54:47 user nova-compute[75469]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 04:54:47 user nova-compute[75469]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 04:54:47 user nova-compute[75469]:     <timer name='hpet' present='no'/>
Nov 14 04:54:47 user nova-compute[75469]:   </clock>
Nov 14 04:54:47 user nova-compute[75469]:   <on_poweroff>destroy</on_poweroff>
Nov 14 04:54:47 user nova-compute[75469]:   <on_reboot>restart</on_reboot>
Nov 14 04:54:47 user nova-compute[75469]:   <on_crash>destroy</on_crash>
Nov 14 04:54:47 user nova-compute[75469]:   <devices>
Nov 14 04:54:47 user nova-compute[75469]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 04:54:47 user nova-compute[75469]:     <disk type='file' device='disk'>
Nov 14 04:54:47 user nova-compute[75469]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 04:54:47 user nova-compute[75469]:       <source file='/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk' index='2'/>
Nov 14 04:54:47 user nova-compute[75469]:       <backingStore type='file' index='3'>
Nov 14 04:54:47 user nova-compute[75469]:         <format type='raw'/>
Nov 14 04:54:47 user nova-compute[75469]:         <source file='/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2'/>
Nov 14 04:54:47 user nova-compute[75469]:         <backingStore/>
Nov 14 04:54:47 user nova-compute[75469]:       </backingStore>
Nov 14 04:54:47 user nova-compute[75469]:       <target dev='vda' bus='virtio'/>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='virtio-disk0'/>
Nov 14 04:54:47 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </disk>
Nov 14 04:54:47 user nova-compute[75469]:     <disk type='file' device='cdrom'>
Nov 14 04:54:47 user nova-compute[75469]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 04:54:47 user nova-compute[75469]:       <source file='/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk.config' index='1'/>
Nov 14 04:54:47 user nova-compute[75469]:       <backingStore/>
Nov 14 04:54:47 user nova-compute[75469]:       <target dev='hda' bus='ide'/>
Nov 14 04:54:47 user nova-compute[75469]:       <readonly/>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='ide0-0-0'/>
Nov 14 04:54:47 user nova-compute[75469]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </disk>
Nov 14 04:54:47 user nova-compute[75469]:     <controller type='usb' index='0' model='none'>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='usb'/>
Nov 14 04:54:47 user nova-compute[75469]:     </controller>
Nov 14 04:54:47 user nova-compute[75469]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='pci.0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </controller>
Nov 14 04:54:47 user nova-compute[75469]:     <controller type='ide' index='0'>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='ide'/>
Nov 14 04:54:47 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 04:54:47 user nova-compute[75469]:     </controller>
Nov 14 04:54:47 user nova-compute[75469]:     <interface type='ethernet'>
Nov 14 04:54:47 user nova-compute[75469]:       <mac address='fa:16:3e:b1:29:fb'/>
Nov 14 04:54:47 user nova-compute[75469]:       <target dev='tapa5d80c3d-3d'/>
Nov 14 04:54:47 user nova-compute[75469]:       <model type='virtio'/>
Nov 14 04:54:47 user nova-compute[75469]:       <mtu size='1442'/>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='net0'/>
Nov 14 04:54:47 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </interface>
Nov 14 04:54:47 user nova-compute[75469]:     <interface type='ethernet'>
Nov 14 04:54:47 user nova-compute[75469]:       <mac address='fa:16:3e:47:84:56'/>
Nov 14 04:54:47 user nova-compute[75469]:       <target dev='tap079c1d45-5d'/>
Nov 14 04:54:47 user nova-compute[75469]:       <model type='virtio'/>
Nov 14 04:54:47 user nova-compute[75469]:       <mtu size='1442'/>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='net1'/>
Nov 14 04:54:47 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </interface>
Nov 14 04:54:47 user nova-compute[75469]:     <serial type='pty'>
Nov 14 04:54:47 user nova-compute[75469]:       <source path='/dev/pts/10'/>
Nov 14 04:54:47 user nova-compute[75469]:       <log file='/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/console.log' append='off'/>
Nov 14 04:54:47 user nova-compute[75469]:       <target type='isa-serial' port='0'>
Nov 14 04:54:47 user nova-compute[75469]:         <model name='isa-serial'/>
Nov 14 04:54:47 user nova-compute[75469]:       </target>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='serial0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </serial>
Nov 14 04:54:47 user nova-compute[75469]:     <console type='pty' tty='/dev/pts/10'>
Nov 14 04:54:47 user nova-compute[75469]:       <source path='/dev/pts/10'/>
Nov 14 04:54:47 user nova-compute[75469]:       <log file='/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/console.log' append='off'/>
Nov 14 04:54:47 user nova-compute[75469]:       <target type='serial' port='0'/>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='serial0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </console>
Nov 14 04:54:47 user nova-compute[75469]:     <input type='mouse' bus='ps2'>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='input0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </input>
Nov 14 04:54:47 user nova-compute[75469]:     <input type='keyboard' bus='ps2'>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='input1'/>
Nov 14 04:54:47 user nova-compute[75469]:     </input>
Nov 14 04:54:47 user nova-compute[75469]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 14 04:54:47 user nova-compute[75469]:       <listen type='address' address='0.0.0.0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </graphics>
Nov 14 04:54:47 user nova-compute[75469]:     <audio id='1' type='none'/>
Nov 14 04:54:47 user nova-compute[75469]:     <video>
Nov 14 04:54:47 user nova-compute[75469]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='video0'/>
Nov 14 04:54:47 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </video>
Nov 14 04:54:47 user nova-compute[75469]:     <memballoon model='virtio'>
Nov 14 04:54:47 user nova-compute[75469]:       <stats period='10'/>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='balloon0'/>
Nov 14 04:54:47 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </memballoon>
Nov 14 04:54:47 user nova-compute[75469]:     <rng model='virtio'>
Nov 14 04:54:47 user nova-compute[75469]:       <backend model='random'>/dev/urandom</backend>
Nov 14 04:54:47 user nova-compute[75469]:       <alias name='rng0'/>
Nov 14 04:54:47 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 04:54:47 user nova-compute[75469]:     </rng>
Nov 14 04:54:47 user nova-compute[75469]:   </devices>
Nov 14 04:54:47 user nova-compute[75469]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 04:54:47 user nova-compute[75469]:     <label>libvirt-c32dcf16-daa4-4370-be69-ebeba12e2b12</label>
Nov 14 04:54:47 user nova-compute[75469]:     <imagelabel>libvirt-c32dcf16-daa4-4370-be69-ebeba12e2b12</imagelabel>
Nov 14 04:54:47 user nova-compute[75469]:   </seclabel>
Nov 14 04:54:47 user nova-compute[75469]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 04:54:47 user nova-compute[75469]:     <label>+64055:+108</label>
Nov 14 04:54:47 user nova-compute[75469]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 04:54:47 user nova-compute[75469]:   </seclabel>
Nov 14 04:54:47 user nova-compute[75469]: </domain>
Nov 14 04:54:47 user nova-compute[75469]:  {{(pid=75469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 04:54:47 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Successfully detached device tap079c1d45-5d from instance c32dcf16-daa4-4370-be69-ebeba12e2b12 from the persistent domain config.
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] (1/8): Attempting to detach device tap079c1d45-5d with device alias net1 from instance c32dcf16-daa4-4370-be69-ebeba12e2b12 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] detach device xml: <interface type="ethernet">
Nov 14 04:54:47 user nova-compute[75469]:   <mac address="fa:16:3e:47:84:56"/>
Nov 14 04:54:47 user nova-compute[75469]:   <model type="virtio"/>
Nov 14 04:54:47 user nova-compute[75469]:   <mtu size="1442"/>
Nov 14 04:54:47 user nova-compute[75469]:   <target dev="tap079c1d45-5d"/>
Nov 14 04:54:47 user nova-compute[75469]: </interface>
Nov 14 04:54:47 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "929364ea-9d56-41ff-a393-8abd7df60eec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:47 user nova-compute[75469]: INFO nova.compute.manager [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.compute.manager [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:54:47 user nova-compute[75469]: INFO nova.compute.claims [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Claim successful on node user
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Start waiting for the detach event from libvirt for device tap079c1d45-5d with device alias net1 for instance c32dcf16-daa4-4370-be69-ebeba12e2b12 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-7d88a9da-24a2-4be8-9b67-218524b100e0 req-ae321e34-4bf1-4cc7-8804-0685dc432630 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-vif-unplugged-079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7d88a9da-24a2-4be8-9b67-218524b100e0 req-ae321e34-4bf1-4cc7-8804-0685dc432630 service nova] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7d88a9da-24a2-4be8-9b67-218524b100e0 req-ae321e34-4bf1-4cc7-8804-0685dc432630 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7d88a9da-24a2-4be8-9b67-218524b100e0 req-ae321e34-4bf1-4cc7-8804-0685dc432630 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-7d88a9da-24a2-4be8-9b67-218524b100e0 req-ae321e34-4bf1-4cc7-8804-0685dc432630 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] No waiting events found dispatching network-vif-unplugged-079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:47 user nova-compute[75469]: WARNING nova.compute.manager [req-7d88a9da-24a2-4be8-9b67-218524b100e0 req-ae321e34-4bf1-4cc7-8804-0685dc432630 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received unexpected event network-vif-unplugged-079c1d45-5dc2-493b-b3cd-27433bb99386 for instance with vm_state active and task_state None.
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:54:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Error from libvirt while getting description of instance-00000009: [Error Code 42] Domain not found: no domain with matching uuid '071f97b4-296b-43aa-8fa9-cf0a69c9764d' (instance-00000009): libvirt.libvirtError: Domain not found: no domain with matching uuid '071f97b4-296b-43aa-8fa9-cf0a69c9764d' (instance-00000009)
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.network.neutron [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:48 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.policy [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a23a8feda3e4d7581666ca3ee20aa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e392b9dd841a4eacab6c4aff4f60e536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.compute.manager [req-092c75b7-74e2-43d7-bf7d-763294933bc6 req-b0c495f9-0560-44c6-80bc-cfcabd5a47ad service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Received event network-vif-deleted-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:48 user nova-compute[75469]: INFO nova.compute.manager [req-092c75b7-74e2-43d7-bf7d-763294933bc6 req-b0c495f9-0560-44c6-80bc-cfcabd5a47ad service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Neutron deleted interface aa599f35-2b08-4d29-9b68-fecf5f4fcaa8; detaching it from the instance and deleting it from the info cache
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.network.neutron [req-092c75b7-74e2-43d7-bf7d-763294933bc6 req-b0c495f9-0560-44c6-80bc-cfcabd5a47ad service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.compute.manager [req-27167e0b-1abe-4c65-8191-3b3f6bf4d4d5 req-ded2e88d-b3cb-4a9f-8dd0-c15f5d9d007e service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Received event network-vif-plugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-27167e0b-1abe-4c65-8191-3b3f6bf4d4d5 req-ded2e88d-b3cb-4a9f-8dd0-c15f5d9d007e service nova] Acquiring lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-27167e0b-1abe-4c65-8191-3b3f6bf4d4d5 req-ded2e88d-b3cb-4a9f-8dd0-c15f5d9d007e service nova] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-27167e0b-1abe-4c65-8191-3b3f6bf4d4d5 req-ded2e88d-b3cb-4a9f-8dd0-c15f5d9d007e service nova] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.compute.manager [req-27167e0b-1abe-4c65-8191-3b3f6bf4d4d5 req-ded2e88d-b3cb-4a9f-8dd0-c15f5d9d007e service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] No waiting events found dispatching network-vif-plugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:48 user nova-compute[75469]: WARNING nova.compute.manager [req-27167e0b-1abe-4c65-8191-3b3f6bf4d4d5 req-ded2e88d-b3cb-4a9f-8dd0-c15f5d9d007e service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Received unexpected event network-vif-plugged-aa599f35-2b08-4d29-9b68-fecf5f4fcaa8 for instance with vm_state active and task_state deleting.
Nov 14 04:54:48 user nova-compute[75469]: INFO nova.virt.block_device [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Booting with blank volume at /dev/vda
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.compute.manager [req-092c75b7-74e2-43d7-bf7d-763294933bc6 req-b0c495f9-0560-44c6-80bc-cfcabd5a47ad service nova] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Detach interface failed, port_id=aa599f35-2b08-4d29-9b68-fecf5f4fcaa8, reason: Instance 071f97b4-296b-43aa-8fa9-cf0a69c9764d could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 04:54:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:54:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:54:48 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7556MB free_disk=25.27973175048828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:48 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 071f97b4-296b-43aa-8fa9-cf0a69c9764d] Took 1.43 seconds to deallocate network for instance.
Nov 14 04:54:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fb551839-7b5a-4ecd-b9c0-ab53addeaa45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 0faef65d-62e0-4d48-92d5-f50395b7d190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance ccd1b71a-7ecb-4060-bb65-e635222bfcd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 1ab6379f-1ffa-4852-a00f-b498b39a2f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 071f97b4-296b-43aa-8fa9-cf0a69c9764d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c32dcf16-daa4-4370-be69-ebeba12e2b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 42daead3-8494-429a-8915-cb88ad87496a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.444s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.network.neutron [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Successfully created port: 44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:49 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Deleted allocations for instance 071f97b4-296b-43aa-8fa9-cf0a69c9764d
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-d1401d8f-8240-4f12-bc9a-0e4f43071d99 req-11eaf767-3c47-4c5a-b132-a9e0421e11c8 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-vif-plugged-079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1401d8f-8240-4f12-bc9a-0e4f43071d99 req-11eaf767-3c47-4c5a-b132-a9e0421e11c8 service nova] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1401d8f-8240-4f12-bc9a-0e4f43071d99 req-11eaf767-3c47-4c5a-b132-a9e0421e11c8 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1401d8f-8240-4f12-bc9a-0e4f43071d99 req-11eaf767-3c47-4c5a-b132-a9e0421e11c8 service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-d1401d8f-8240-4f12-bc9a-0e4f43071d99 req-11eaf767-3c47-4c5a-b132-a9e0421e11c8 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] No waiting events found dispatching network-vif-plugged-079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:54:49 user nova-compute[75469]: WARNING nova.compute.manager [req-d1401d8f-8240-4f12-bc9a-0e4f43071d99 req-11eaf767-3c47-4c5a-b132-a9e0421e11c8 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received unexpected event network-vif-plugged-079c1d45-5dc2-493b-b3cd-27433bb99386 for instance with vm_state active and task_state None.
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e0395e4c-47f0-4b3f-99a5-3fac98b8a089 tempest-AttachSCSIVolumeTestJSON-745995412 tempest-AttachSCSIVolumeTestJSON-745995412-project-member] Lock "071f97b4-296b-43aa-8fa9-cf0a69c9764d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.931s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:50 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 42daead3-8494-429a-8915-cb88ad87496a is timed out.
Nov 14 04:54:50 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Successfully detached device vdb from instance 42daead3-8494-429a-8915-cb88ad87496a from the live domain config.
Nov 14 04:54:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] [instance: 42daead3-8494-429a-8915-cb88ad87496a] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZfESAPRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:50 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b442b26-1eed-49cb-9d7f-811b2e202f42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:54:50 user nova-compute[75469]: No targets found.
Nov 14 04:54:50 user nova-compute[75469]: iSNS:
Nov 14 04:54:50 user nova-compute[75469]: No targets found.
Nov 14 04:54:50 user nova-compute[75469]: STATIC:
Nov 14 04:54:50 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:54:50 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:50 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:50 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429
Nov 14 04:54:50 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:50 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:50 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:54:50 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:50 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:50 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6
Nov 14 04:54:50 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:54:50 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:54:50 user nova-compute[75469]: FIRMWARE:
Nov 14 04:54:50 user nova-compute[75469]: No targets found.
Nov 14 04:54:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:54:50 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:54:50 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a8ac11-09fe-4002-89b2-a8e87adb3e88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12275bb-d9e5-4693-b6e2-69bf6c34c57d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:50 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:50 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:50 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 (non-flash)
Nov 14 04:54:50 user nova-compute[75469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:50 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:50 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c297910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429'): ({'sdk'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Removing single pathed devices sdk {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d1306e-0a29-4a72-b198-ef3cc85ec7e9]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc64eecf-348a-4ee0-ad81-3105e18c2046]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Flushing IO for device /dev/sdk {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[da455e63-4e0b-4039-a904-3c96cafc3a49]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.038s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[236bfb32-47b9-4ef5-ad7d-85a92f1e371c]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] SCSI volumes sdk have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a59a7b-2eda-4579-b392-67230a0bcdbb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a1a072-dc37-45a4-a24f-b9baee4c6bea]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429, portal: 172.16.0.220,3260]
Nov 14 04:54:50 user nova-compute[75469]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Successfully updated port: 44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a316d067-1df3-4ea2-9390-00e967d16429 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14aac6a-2ce9-4f9e-b016-21170897b2b0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] <== disconnect_volume: return (341ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquired lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG nova.compute.manager [req-8e8d4c69-234a-49d0-9bb1-d1e8b8aab730 req-9dc434de-89cc-45d4-8706-25efc1db6468 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-changed-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG nova.compute.manager [req-8e8d4c69-234a-49d0-9bb1-d1e8b8aab730 req-9dc434de-89cc-45d4-8706-25efc1db6468 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Refreshing instance network info cache due to event network-changed-44003f19-d7b1-4227-bbef-774fb01f1431. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8e8d4c69-234a-49d0-9bb1-d1e8b8aab730 req-9dc434de-89cc-45d4-8706-25efc1db6468 service nova] Acquiring lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updating instance_info_cache with network_info: [{"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Releasing lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Instance network_info: |[{"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8e8d4c69-234a-49d0-9bb1-d1e8b8aab730 req-9dc434de-89cc-45d4-8706-25efc1db6468 service nova] Acquired lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG nova.network.neutron [req-8e8d4c69-234a-49d0-9bb1-d1e8b8aab730 req-9dc434de-89cc-45d4-8706-25efc1db6468 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Refreshing network info cache for port 44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:54:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:51 user nova-compute[75469]: DEBUG nova.network.neutron [req-8e8d4c69-234a-49d0-9bb1-d1e8b8aab730 req-9dc434de-89cc-45d4-8706-25efc1db6468 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updated VIF entry in instance network info cache for port 44003f19-d7b1-4227-bbef-774fb01f1431. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:54:51 user nova-compute[75469]: DEBUG nova.network.neutron [req-8e8d4c69-234a-49d0-9bb1-d1e8b8aab730 req-9dc434de-89cc-45d4-8706-25efc1db6468 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updating instance_info_cache with network_info: [{"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:54:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8e8d4c69-234a-49d0-9bb1-d1e8b8aab730 req-9dc434de-89cc-45d4-8706-25efc1db6468 service nova] Releasing lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:54:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:52 user nova-compute[75469]: DEBUG nova.objects.instance [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lazy-loading 'flavor' on Instance uuid 42daead3-8494-429a-8915-cb88ad87496a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:54:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bf877f65-0fbf-432c-9daf-430d497c8a27 tempest-VolumesAssistedSnapshotsTest-2044556904 tempest-VolumesAssistedSnapshotsTest-2044556904-project-admin] Lock "42daead3-8494-429a-8915-cb88ad87496a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.383s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG os_brick.utils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f6821e-2d39-4a81-8efa-c226eb464e76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8153ad12-a798-4bf9-90a0-386a842a2df7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[88079720-aced-4a8b-90b0-91413887031c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[328794c5-b976-4255-a7ee-1619ae6b728f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:54:54 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:54:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1681fd89-8661-4e5d-b341-ba78833edbb0]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG os_brick.utils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:54:54 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updating existing volume attachment record: 3eed3e3b-e72e-470c-8795-ad2281bfed53 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:54:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:54:59 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Creating image(s)
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Ensure instance console log exists: /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Start _get_guest_xml network_info=[{"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '3eed3e3b-e72e-470c-8795-ad2281bfed53', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMLfgOGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '929364ea-9d56-41ff-a393-8abd7df60eec', 'attached_at': '', 'detached_at': '', 'volume_id': '1e607621-505d-441b-869a-10a26d80e970', 'serial': '1e607621-505d-441b-869a-10a26d80e970'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:54:59 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:54:59 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMLfgOGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:54:59 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:59 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:54:59 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cf839c-3e43-4f56-a9fc-1a6d2a8563f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:54:59 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87d902e-14b8-45ef-972c-05e49c24a6e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970] added
Nov 14 04:54:59 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[153e197f-9cae-4547-ba88-dccd1205351d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55cc2ab-5b6a-4e2e-bc4b-032fb8e3b3ff]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMLfgOGB {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMLfgOGB" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d93ac7-c0d6-4ca3-99a9-150f9527aa39]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uMLfgOGB'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e426c7b-65d2-42aa-bfe6-4e8215ce871c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4d0b3f-0318-4d7d-b156-6cf4215483da]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:59 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:59 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:59 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:59 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:59 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:59 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5877799-44b7-44da-907f-a4c6d110aeae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970, portal: 172.16.0.220,3260]
Nov 14 04:54:59 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970, portal: 172.16.0.220,3260] successful.
Nov 14 04:54:59 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62660b6-78fa-4ec1-8c3d-af74ec6c4083]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ef8f01-c45f-4715-897b-0ab921303002]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:59 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:59 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:54:59 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:59 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:54:59 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:54:59 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:54:59 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:54:59 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a16769-30a1-48b6-b95e-ff408d3e6519]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:54:59 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMLfgOGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23963323036636239', 'path': '/dev/sdc'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963323036636239', 'path': '/dev/sdc'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2102515421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2102515421',id=13,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-lwtjrbx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:54:48Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=929364ea-9d56-41ff-a393-8abd7df60eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:04:a0,bridge_name='br-int',has_traffic_filtering=True,id=44003f19-d7b1-4227-bbef-774fb01f1431,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44003f19-d7') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG nova.objects.instance [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'pci_devices' on Instance uuid 929364ea-9d56-41ff-a393-8abd7df60eec {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:55:00 user nova-compute[75469]:   <uuid>929364ea-9d56-41ff-a393-8abd7df60eec</uuid>
Nov 14 04:55:00 user nova-compute[75469]:   <name>instance-0000000d</name>
Nov 14 04:55:00 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:55:00 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:55:00 user nova-compute[75469]:   <metadata>
Nov 14 04:55:00 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:55:00 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:55:00 user nova-compute[75469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2102515421</nova:name>
Nov 14 04:55:00 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:54:59</nova:creationTime>
Nov 14 04:55:00 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:55:00 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:55:00 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:55:00 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:55:00 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:55:00 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:55:00 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:55:00 user nova-compute[75469]:       <nova:owner>
Nov 14 04:55:00 user nova-compute[75469]:         <nova:user uuid="3a23a8feda3e4d7581666ca3ee20aa5f">tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member</nova:user>
Nov 14 04:55:00 user nova-compute[75469]:         <nova:project uuid="e392b9dd841a4eacab6c4aff4f60e536">tempest-ServerBootFromVolumeStableRescueTest-1634984639</nova:project>
Nov 14 04:55:00 user nova-compute[75469]:       </nova:owner>
Nov 14 04:55:00 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:55:00 user nova-compute[75469]:       <nova:ports>
Nov 14 04:55:00 user nova-compute[75469]:         <nova:port uuid="44003f19-d7b1-4227-bbef-774fb01f1431">
Nov 14 04:55:00 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 04:55:00 user nova-compute[75469]:         </nova:port>
Nov 14 04:55:00 user nova-compute[75469]:       </nova:ports>
Nov 14 04:55:00 user nova-compute[75469]:     </nova:instance>
Nov 14 04:55:00 user nova-compute[75469]:   </metadata>
Nov 14 04:55:00 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:55:00 user nova-compute[75469]:     <system>
Nov 14 04:55:00 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:55:00 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:55:00 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:55:00 user nova-compute[75469]:       <entry name="serial">929364ea-9d56-41ff-a393-8abd7df60eec</entry>
Nov 14 04:55:00 user nova-compute[75469]:       <entry name="uuid">929364ea-9d56-41ff-a393-8abd7df60eec</entry>
Nov 14 04:55:00 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:55:00 user nova-compute[75469]:     </system>
Nov 14 04:55:00 user nova-compute[75469]:   </sysinfo>
Nov 14 04:55:00 user nova-compute[75469]:   <os>
Nov 14 04:55:00 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:55:00 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:55:00 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:55:00 user nova-compute[75469]:   </os>
Nov 14 04:55:00 user nova-compute[75469]:   <features>
Nov 14 04:55:00 user nova-compute[75469]:     <acpi/>
Nov 14 04:55:00 user nova-compute[75469]:     <apic/>
Nov 14 04:55:00 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:55:00 user nova-compute[75469]:   </features>
Nov 14 04:55:00 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:55:00 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:55:00 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:55:00 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:55:00 user nova-compute[75469]:   </clock>
Nov 14 04:55:00 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:55:00 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:55:00 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:55:00 user nova-compute[75469]:   </cpu>
Nov 14 04:55:00 user nova-compute[75469]:   <devices>
Nov 14 04:55:00 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:55:00 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:55:00 user nova-compute[75469]:       <source dev="/dev/sdc"/>
Nov 14 04:55:00 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:55:00 user nova-compute[75469]:       <serial>1e607621-505d-441b-869a-10a26d80e970</serial>
Nov 14 04:55:00 user nova-compute[75469]:     </disk>
Nov 14 04:55:00 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:55:00 user nova-compute[75469]:       <mac address="fa:16:3e:c3:04:a0"/>
Nov 14 04:55:00 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:55:00 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:55:00 user nova-compute[75469]:       <target dev="tap44003f19-d7"/>
Nov 14 04:55:00 user nova-compute[75469]:     </interface>
Nov 14 04:55:00 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:55:00 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/console.log" append="off"/>
Nov 14 04:55:00 user nova-compute[75469]:     </serial>
Nov 14 04:55:00 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:55:00 user nova-compute[75469]:     <video>
Nov 14 04:55:00 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:55:00 user nova-compute[75469]:     </video>
Nov 14 04:55:00 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:55:00 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:55:00 user nova-compute[75469]:     </rng>
Nov 14 04:55:00 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:55:00 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:55:00 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:55:00 user nova-compute[75469]:     </memballoon>
Nov 14 04:55:00 user nova-compute[75469]:   </devices>
Nov 14 04:55:00 user nova-compute[75469]: </domain>
Nov 14 04:55:00 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2102515421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2102515421',id=13,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-lwtjrbx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:54:48Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=929364ea-9d56-41ff-a393-8abd7df60eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:04:a0,bridge_name='br-int',has_traffic_filtering=True,id=44003f19-d7b1-4227-bbef-774fb01f1431,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44003f19-d7') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG os_vif [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:04:a0,bridge_name='br-int',has_traffic_filtering=True,id=44003f19-d7b1-4227-bbef-774fb01f1431,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44003f19-d7') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e991c2c-3a9c-5f97-991c-906fbc106007', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44003f19-d7, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44003f19-d7, col_values=(('qos', UUID('f364a328-c8c8-41c4-beaa-88a68ba00350')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44003f19-d7, col_values=(('external_ids', {'iface-id': '44003f19-d7b1-4227-bbef-774fb01f1431', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:04:a0', 'vm-uuid': '929364ea-9d56-41ff-a393-8abd7df60eec'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:00 user nova-compute[75469]: INFO os_vif [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:04:a0,bridge_name='br-int',has_traffic_filtering=True,id=44003f19-d7b1-4227-bbef-774fb01f1431,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44003f19-d7')
Nov 14 04:55:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No VIF found with MAC fa:16:3e:c3:04:a0, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:55:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-0cbbe7a1-93ba-434e-94cd-b4434c33a003 req-e964caad-9ccd-4cec-899f-7b79df84e76c service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0cbbe7a1-93ba-434e-94cd-b4434c33a003 req-e964caad-9ccd-4cec-899f-7b79df84e76c service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0cbbe7a1-93ba-434e-94cd-b4434c33a003 req-e964caad-9ccd-4cec-899f-7b79df84e76c service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0cbbe7a1-93ba-434e-94cd-b4434c33a003 req-e964caad-9ccd-4cec-899f-7b79df84e76c service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-0cbbe7a1-93ba-434e-94cd-b4434c33a003 req-e964caad-9ccd-4cec-899f-7b79df84e76c service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:02 user nova-compute[75469]: WARNING nova.compute.manager [req-0cbbe7a1-93ba-434e-94cd-b4434c33a003 req-e964caad-9ccd-4cec-899f-7b79df84e76c service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received unexpected event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with vm_state building and task_state spawning.
Nov 14 04:55:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "73091efc-4129-40a8-8d82-c852ac6fa0c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:03 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:55:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:55:03 user nova-compute[75469]: INFO nova.compute.claims [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Claim successful on node user
Nov 14 04:55:03 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:55:03 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:55:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:03 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:55:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:55:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Instance spawned successfully.
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.policy [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb5695c4e5d74c269678220aa4e1b9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2c1e6fdb7497aab43cd768f8ea236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:55:04 user nova-compute[75469]: INFO nova.compute.manager [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:55:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Creating image(s)
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "/opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "/opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "/opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-8893046b-0c2c-4bd1-aa3e-341ffcbca2b8 req-37e33967-ff93-4f1b-80cf-67982f2e7a37 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8893046b-0c2c-4bd1-aa3e-341ffcbca2b8 req-37e33967-ff93-4f1b-80cf-67982f2e7a37 service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8893046b-0c2c-4bd1-aa3e-341ffcbca2b8 req-37e33967-ff93-4f1b-80cf-67982f2e7a37 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8893046b-0c2c-4bd1-aa3e-341ffcbca2b8 req-37e33967-ff93-4f1b-80cf-67982f2e7a37 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-8893046b-0c2c-4bd1-aa3e-341ffcbca2b8 req-37e33967-ff93-4f1b-80cf-67982f2e7a37 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:04 user nova-compute[75469]: WARNING nova.compute.manager [req-8893046b-0c2c-4bd1-aa3e-341ffcbca2b8 req-37e33967-ff93-4f1b-80cf-67982f2e7a37 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received unexpected event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with vm_state building and task_state spawning.
Nov 14 04:55:04 user nova-compute[75469]: INFO nova.compute.manager [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Took 16.74 seconds to build instance.
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-30e889a1-b134-47cc-bbee-28a14579276c tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "929364ea-9d56-41ff-a393-8abd7df60eec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.859s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk 1073741824" returned: 0 in 0.073s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Successfully created port: 27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Cannot resize image /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Ensure instance console log exists: /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Successfully updated port: 27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "refresh_cache-73091efc-4129-40a8-8d82-c852ac6fa0c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquired lock "refresh_cache-73091efc-4129-40a8-8d82-c852ac6fa0c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-1a9ee725-2d58-40fa-b8ff-d9af575271ef req-6d5f6259-e432-422a-9c97-a1dc9b780172 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Received event network-changed-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-1a9ee725-2d58-40fa-b8ff-d9af575271ef req-6d5f6259-e432-422a-9c97-a1dc9b780172 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Refreshing instance network info cache due to event network-changed-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1a9ee725-2d58-40fa-b8ff-d9af575271ef req-6d5f6259-e432-422a-9c97-a1dc9b780172 service nova] Acquiring lock "refresh_cache-73091efc-4129-40a8-8d82-c852ac6fa0c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Updating instance_info_cache with network_info: [{"id": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "address": "fa:16:3e:c7:03:17", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f44f0b-f5", "ovs_interfaceid": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Releasing lock "refresh_cache-73091efc-4129-40a8-8d82-c852ac6fa0c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Instance network_info: |[{"id": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "address": "fa:16:3e:c7:03:17", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f44f0b-f5", "ovs_interfaceid": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1a9ee725-2d58-40fa-b8ff-d9af575271ef req-6d5f6259-e432-422a-9c97-a1dc9b780172 service nova] Acquired lock "refresh_cache-73091efc-4129-40a8-8d82-c852ac6fa0c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.network.neutron [req-1a9ee725-2d58-40fa-b8ff-d9af575271ef req-6d5f6259-e432-422a-9c97-a1dc9b780172 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Refreshing network info cache for port 27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Start _get_guest_xml network_info=[{"id": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "address": "fa:16:3e:c7:03:17", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f44f0b-f5", "ovs_interfaceid": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:55:05 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:55:05 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-857984884',display_name='tempest-VolumesAdminNegativeTest-server-857984884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-857984884',id=14,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c2c1e6fdb7497aab43cd768f8ea236',ramdisk_id='',reservation_id='r-5umusk90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1455966896',owner_user_name='tempest-VolumesAdminNegativeTest-1455966896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:55:04Z,user_data=None,user_id='cb5695c4e5d74c269678220aa4e1b9bf',uuid=73091efc-4129-40a8-8d82-c852ac6fa0c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "address": "fa:16:3e:c7:03:17", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f44f0b-f5", "ovs_interfaceid": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converting VIF {"id": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "address": "fa:16:3e:c7:03:17", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f44f0b-f5", "ovs_interfaceid": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:03:17,bridge_name='br-int',has_traffic_filtering=True,id=27f44f0b-f5e3-4ba9-a320-c41109cb8f4c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f44f0b-f5') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lazy-loading 'pci_devices' on Instance uuid 73091efc-4129-40a8-8d82-c852ac6fa0c5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:55:05 user nova-compute[75469]:   <uuid>73091efc-4129-40a8-8d82-c852ac6fa0c5</uuid>
Nov 14 04:55:05 user nova-compute[75469]:   <name>instance-0000000e</name>
Nov 14 04:55:05 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:55:05 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:55:05 user nova-compute[75469]:   <metadata>
Nov 14 04:55:05 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:55:05 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:55:05 user nova-compute[75469]:       <nova:name>tempest-VolumesAdminNegativeTest-server-857984884</nova:name>
Nov 14 04:55:05 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:55:05</nova:creationTime>
Nov 14 04:55:05 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:55:05 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:55:05 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:55:05 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:55:05 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:55:05 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:55:05 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:55:05 user nova-compute[75469]:       <nova:owner>
Nov 14 04:55:05 user nova-compute[75469]:         <nova:user uuid="cb5695c4e5d74c269678220aa4e1b9bf">tempest-VolumesAdminNegativeTest-1455966896-project-member</nova:user>
Nov 14 04:55:05 user nova-compute[75469]:         <nova:project uuid="94c2c1e6fdb7497aab43cd768f8ea236">tempest-VolumesAdminNegativeTest-1455966896</nova:project>
Nov 14 04:55:05 user nova-compute[75469]:       </nova:owner>
Nov 14 04:55:05 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:55:05 user nova-compute[75469]:       <nova:ports>
Nov 14 04:55:05 user nova-compute[75469]:         <nova:port uuid="27f44f0b-f5e3-4ba9-a320-c41109cb8f4c">
Nov 14 04:55:05 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 04:55:05 user nova-compute[75469]:         </nova:port>
Nov 14 04:55:05 user nova-compute[75469]:       </nova:ports>
Nov 14 04:55:05 user nova-compute[75469]:     </nova:instance>
Nov 14 04:55:05 user nova-compute[75469]:   </metadata>
Nov 14 04:55:05 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:55:05 user nova-compute[75469]:     <system>
Nov 14 04:55:05 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:55:05 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:55:05 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:55:05 user nova-compute[75469]:       <entry name="serial">73091efc-4129-40a8-8d82-c852ac6fa0c5</entry>
Nov 14 04:55:05 user nova-compute[75469]:       <entry name="uuid">73091efc-4129-40a8-8d82-c852ac6fa0c5</entry>
Nov 14 04:55:05 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:55:05 user nova-compute[75469]:     </system>
Nov 14 04:55:05 user nova-compute[75469]:   </sysinfo>
Nov 14 04:55:05 user nova-compute[75469]:   <os>
Nov 14 04:55:05 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:55:05 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:55:05 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:55:05 user nova-compute[75469]:   </os>
Nov 14 04:55:05 user nova-compute[75469]:   <features>
Nov 14 04:55:05 user nova-compute[75469]:     <acpi/>
Nov 14 04:55:05 user nova-compute[75469]:     <apic/>
Nov 14 04:55:05 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:55:05 user nova-compute[75469]:   </features>
Nov 14 04:55:05 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:55:05 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:55:05 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:55:05 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:55:05 user nova-compute[75469]:   </clock>
Nov 14 04:55:05 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:55:05 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:55:05 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:55:05 user nova-compute[75469]:   </cpu>
Nov 14 04:55:05 user nova-compute[75469]:   <devices>
Nov 14 04:55:05 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:55:05 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:55:05 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk"/>
Nov 14 04:55:05 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:55:05 user nova-compute[75469]:     </disk>
Nov 14 04:55:05 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:55:05 user nova-compute[75469]:       <mac address="fa:16:3e:c7:03:17"/>
Nov 14 04:55:05 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:55:05 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:55:05 user nova-compute[75469]:       <target dev="tap27f44f0b-f5"/>
Nov 14 04:55:05 user nova-compute[75469]:     </interface>
Nov 14 04:55:05 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:55:05 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/console.log" append="off"/>
Nov 14 04:55:05 user nova-compute[75469]:     </serial>
Nov 14 04:55:05 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:55:05 user nova-compute[75469]:     <video>
Nov 14 04:55:05 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:55:05 user nova-compute[75469]:     </video>
Nov 14 04:55:05 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:55:05 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:55:05 user nova-compute[75469]:     </rng>
Nov 14 04:55:05 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:55:05 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:55:05 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:55:05 user nova-compute[75469]:     </memballoon>
Nov 14 04:55:05 user nova-compute[75469]:   </devices>
Nov 14 04:55:05 user nova-compute[75469]: </domain>
Nov 14 04:55:05 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-857984884',display_name='tempest-VolumesAdminNegativeTest-server-857984884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-857984884',id=14,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c2c1e6fdb7497aab43cd768f8ea236',ramdisk_id='',reservation_id='r-5umusk90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1455966896',owner_user_name='tempest-VolumesAdminNegativeTest-1455966896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:55:04Z,user_data=None,user_id='cb5695c4e5d74c269678220aa4e1b9bf',uuid=73091efc-4129-40a8-8d82-c852ac6fa0c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "address": "fa:16:3e:c7:03:17", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f44f0b-f5", "ovs_interfaceid": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converting VIF {"id": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "address": "fa:16:3e:c7:03:17", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f44f0b-f5", "ovs_interfaceid": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:03:17,bridge_name='br-int',has_traffic_filtering=True,id=27f44f0b-f5e3-4ba9-a320-c41109cb8f4c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f44f0b-f5') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG os_vif [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:03:17,bridge_name='br-int',has_traffic_filtering=True,id=27f44f0b-f5e3-4ba9-a320-c41109cb8f4c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f44f0b-f5') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d1b0494-44e1-598c-91c0-c04ca4ce6c8c', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27f44f0b-f5, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27f44f0b-f5, col_values=(('qos', UUID('dd16dfb6-2c65-4f5a-816a-bd48014b33ef')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27f44f0b-f5, col_values=(('external_ids', {'iface-id': '27f44f0b-f5e3-4ba9-a320-c41109cb8f4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:03:17', 'vm-uuid': '73091efc-4129-40a8-8d82-c852ac6fa0c5'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:05 user nova-compute[75469]: INFO os_vif [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:03:17,bridge_name='br-int',has_traffic_filtering=True,id=27f44f0b-f5e3-4ba9-a320-c41109cb8f4c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f44f0b-f5')
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] No VIF found with MAC fa:16:3e:c7:03:17, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG nova.network.neutron [req-1a9ee725-2d58-40fa-b8ff-d9af575271ef req-6d5f6259-e432-422a-9c97-a1dc9b780172 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Updated VIF entry in instance network info cache for port 27f44f0b-f5e3-4ba9-a320-c41109cb8f4c. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG nova.network.neutron [req-1a9ee725-2d58-40fa-b8ff-d9af575271ef req-6d5f6259-e432-422a-9c97-a1dc9b780172 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Updating instance_info_cache with network_info: [{"id": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "address": "fa:16:3e:c7:03:17", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f44f0b-f5", "ovs_interfaceid": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1a9ee725-2d58-40fa-b8ff-d9af575271ef req-6d5f6259-e432-422a-9c97-a1dc9b780172 service nova] Releasing lock "refresh_cache-73091efc-4129-40a8-8d82-c852ac6fa0c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:55:06 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1ab6379f-1ffa-4852-a00f-b498b39a2f3d is timed out.
Nov 14 04:55:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Successfully detached device vdb from instance 1ab6379f-1ffa-4852-a00f-b498b39a2f3d from the live domain config.
Nov 14 04:55:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdsKPQVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '7579bc3a-c6b8-47b6-a373-20c04568e4b6'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:55:06 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9208f1b2-2bcb-4734-b4e4-892a1ca7710c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:55:06 user nova-compute[75469]: No targets found.
Nov 14 04:55:06 user nova-compute[75469]: iSNS:
Nov 14 04:55:06 user nova-compute[75469]: No targets found.
Nov 14 04:55:06 user nova-compute[75469]: STATIC:
Nov 14 04:55:06 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:55:06 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:06 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:06 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:55:06 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:06 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:06 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 04:55:06 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:06 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:06 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6
Nov 14 04:55:06 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:06 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:06 user nova-compute[75469]: FIRMWARE:
Nov 14 04:55:06 user nova-compute[75469]: No targets found.
Nov 14 04:55:06 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:55:06 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:55:06 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[11614c3a-a0c6-48bf-9421-8d7049237e54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4e0caa-3105-41ea-bf50-9fbbc650da44]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:06 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:55:06 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:06 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:06 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:06 user nova-compute[75469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 (non-flash)
Nov 14 04:55:06 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:06 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:06 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f836d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2289c6b1-737d-404d-a542-147e347e72cf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dd1285-00ce-4405-b081-5b4a7471b7aa]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e449e60c-a23c-4b22-8e03-721b59393a4b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d6aeb2-1163-450d-8bf3-386305bc3e44]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3245d49e-67c9-4a74-a363-f432bce4ddb2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eda385-b17f-4ef3-94a2-ed8946e6eb88]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260]
Nov 14 04:55:07 user nova-compute[75469]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6, portal: 172.16.0.220,3260] successful.
Nov 14 04:55:07 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7579bc3a-c6b8-47b6-a373-20c04568e4b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d0d5e9-8b13-4dd2-9f1d-fd5f46528a5d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] <== disconnect_volume: return (309ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-e264e26d-a86f-4e66-a0a8-61de94150021 req-c3a00c21-a886-4596-919c-09abef131630 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Received event network-vif-plugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e264e26d-a86f-4e66-a0a8-61de94150021 req-c3a00c21-a886-4596-919c-09abef131630 service nova] Acquiring lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e264e26d-a86f-4e66-a0a8-61de94150021 req-c3a00c21-a886-4596-919c-09abef131630 service nova] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e264e26d-a86f-4e66-a0a8-61de94150021 req-c3a00c21-a886-4596-919c-09abef131630 service nova] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-e264e26d-a86f-4e66-a0a8-61de94150021 req-c3a00c21-a886-4596-919c-09abef131630 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] No waiting events found dispatching network-vif-plugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:07 user nova-compute[75469]: WARNING nova.compute.manager [req-e264e26d-a86f-4e66-a0a8-61de94150021 req-c3a00c21-a886-4596-919c-09abef131630 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Received unexpected event network-vif-plugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c for instance with vm_state building and task_state spawning.
Nov 14 04:55:07 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Waiting for libvirt event about the detach of device tap079c1d45-5d with device alias net1 from instance c32dcf16-daa4-4370-be69-ebeba12e2b12 is timed out.
Nov 14 04:55:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:84:56"/><model type="virtio"/><mtu size="1442"/><target dev="tap079c1d45-5d"/></interface> {{(pid=75469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:84:56"/><model type="virtio"/><mtu size="1442"/><target dev="tap079c1d45-5d"/></interface>not found in domain: <domain type='kvm' id='10'>
Nov 14 04:55:07 user nova-compute[75469]:   <name>instance-0000000a</name>
Nov 14 04:55:07 user nova-compute[75469]:   <uuid>c32dcf16-daa4-4370-be69-ebeba12e2b12</uuid>
Nov 14 04:55:07 user nova-compute[75469]:   <metadata>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:55:07 user nova-compute[75469]:   <nova:package version="0.0.0"/>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:name>tempest-device-tagging-server-4526189</nova:name>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:creationTime>2023-11-14 04:54:15</nova:creationTime>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:flavor name="m1.tiny">
Nov 14 04:55:07 user nova-compute[75469]:     <nova:memory>512</nova:memory>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:disk>1</nova:disk>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:swap>0</nova:swap>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:vcpus>1</nova:vcpus>
Nov 14 04:55:07 user nova-compute[75469]:   </nova:flavor>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:owner>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:user uuid="c4371d2e15d6486b8b6aafd72905b1e5">tempest-TaggedAttachmentsTest-1158979709-project-member</nova:user>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:project uuid="4cab74b837d742b2bf746eaf0f8a8d5f">tempest-TaggedAttachmentsTest-1158979709</nova:project>
Nov 14 04:55:07 user nova-compute[75469]:   </nova:owner>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:ports>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:port uuid="a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f">
Nov 14 04:55:07 user nova-compute[75469]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 04:55:07 user nova-compute[75469]:     </nova:port>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:port uuid="079c1d45-5dc2-493b-b3cd-27433bb99386">
Nov 14 04:55:07 user nova-compute[75469]:       <nova:ip type="fixed" address="10.10.10.8" ipVersion="4"/>
Nov 14 04:55:07 user nova-compute[75469]:     </nova:port>
Nov 14 04:55:07 user nova-compute[75469]:   </nova:ports>
Nov 14 04:55:07 user nova-compute[75469]: </nova:instance>
Nov 14 04:55:07 user nova-compute[75469]:   </metadata>
Nov 14 04:55:07 user nova-compute[75469]:   <memory unit='KiB'>524288</memory>
Nov 14 04:55:07 user nova-compute[75469]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 04:55:07 user nova-compute[75469]:   <vcpu placement='static'>1</vcpu>
Nov 14 04:55:07 user nova-compute[75469]:   <resource>
Nov 14 04:55:07 user nova-compute[75469]:     <partition>/machine</partition>
Nov 14 04:55:07 user nova-compute[75469]:   </resource>
Nov 14 04:55:07 user nova-compute[75469]:   <sysinfo type='smbios'>
Nov 14 04:55:07 user nova-compute[75469]:     <system>
Nov 14 04:55:07 user nova-compute[75469]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 04:55:07 user nova-compute[75469]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 04:55:07 user nova-compute[75469]:       <entry name='version'>0.0.0</entry>
Nov 14 04:55:07 user nova-compute[75469]:       <entry name='serial'>c32dcf16-daa4-4370-be69-ebeba12e2b12</entry>
Nov 14 04:55:07 user nova-compute[75469]:       <entry name='uuid'>c32dcf16-daa4-4370-be69-ebeba12e2b12</entry>
Nov 14 04:55:07 user nova-compute[75469]:       <entry name='family'>Virtual Machine</entry>
Nov 14 04:55:07 user nova-compute[75469]:     </system>
Nov 14 04:55:07 user nova-compute[75469]:   </sysinfo>
Nov 14 04:55:07 user nova-compute[75469]:   <os>
Nov 14 04:55:07 user nova-compute[75469]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 04:55:07 user nova-compute[75469]:     <boot dev='hd'/>
Nov 14 04:55:07 user nova-compute[75469]:     <smbios mode='sysinfo'/>
Nov 14 04:55:07 user nova-compute[75469]:   </os>
Nov 14 04:55:07 user nova-compute[75469]:   <features>
Nov 14 04:55:07 user nova-compute[75469]:     <acpi/>
Nov 14 04:55:07 user nova-compute[75469]:     <apic/>
Nov 14 04:55:07 user nova-compute[75469]:     <vmcoreinfo state='on'/>
Nov 14 04:55:07 user nova-compute[75469]:   </features>
Nov 14 04:55:07 user nova-compute[75469]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 04:55:07 user nova-compute[75469]:     <model fallback='forbid'>Nehalem</model>
Nov 14 04:55:07 user nova-compute[75469]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 04:55:07 user nova-compute[75469]:     <feature policy='require' name='vme'/>
Nov 14 04:55:07 user nova-compute[75469]:     <feature policy='require' name='x2apic'/>
Nov 14 04:55:07 user nova-compute[75469]:     <feature policy='require' name='hypervisor'/>
Nov 14 04:55:07 user nova-compute[75469]:   </cpu>
Nov 14 04:55:07 user nova-compute[75469]:   <clock offset='utc'>
Nov 14 04:55:07 user nova-compute[75469]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 04:55:07 user nova-compute[75469]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 04:55:07 user nova-compute[75469]:     <timer name='hpet' present='no'/>
Nov 14 04:55:07 user nova-compute[75469]:   </clock>
Nov 14 04:55:07 user nova-compute[75469]:   <on_poweroff>destroy</on_poweroff>
Nov 14 04:55:07 user nova-compute[75469]:   <on_reboot>restart</on_reboot>
Nov 14 04:55:07 user nova-compute[75469]:   <on_crash>destroy</on_crash>
Nov 14 04:55:07 user nova-compute[75469]:   <devices>
Nov 14 04:55:07 user nova-compute[75469]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 04:55:07 user nova-compute[75469]:     <disk type='file' device='disk'>
Nov 14 04:55:07 user nova-compute[75469]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 04:55:07 user nova-compute[75469]:       <source file='/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk' index='2'/>
Nov 14 04:55:07 user nova-compute[75469]:       <backingStore type='file' index='3'>
Nov 14 04:55:07 user nova-compute[75469]:         <format type='raw'/>
Nov 14 04:55:07 user nova-compute[75469]:         <source file='/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2'/>
Nov 14 04:55:07 user nova-compute[75469]:         <backingStore/>
Nov 14 04:55:07 user nova-compute[75469]:       </backingStore>
Nov 14 04:55:07 user nova-compute[75469]:       <target dev='vda' bus='virtio'/>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='virtio-disk0'/>
Nov 14 04:55:07 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 04:55:07 user nova-compute[75469]:     </disk>
Nov 14 04:55:07 user nova-compute[75469]:     <disk type='file' device='cdrom'>
Nov 14 04:55:07 user nova-compute[75469]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 04:55:07 user nova-compute[75469]:       <source file='/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/disk.config' index='1'/>
Nov 14 04:55:07 user nova-compute[75469]:       <backingStore/>
Nov 14 04:55:07 user nova-compute[75469]:       <target dev='hda' bus='ide'/>
Nov 14 04:55:07 user nova-compute[75469]:       <readonly/>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='ide0-0-0'/>
Nov 14 04:55:07 user nova-compute[75469]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 04:55:07 user nova-compute[75469]:     </disk>
Nov 14 04:55:07 user nova-compute[75469]:     <controller type='usb' index='0' model='none'>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='usb'/>
Nov 14 04:55:07 user nova-compute[75469]:     </controller>
Nov 14 04:55:07 user nova-compute[75469]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='pci.0'/>
Nov 14 04:55:07 user nova-compute[75469]:     </controller>
Nov 14 04:55:07 user nova-compute[75469]:     <controller type='ide' index='0'>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='ide'/>
Nov 14 04:55:07 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 04:55:07 user nova-compute[75469]:     </controller>
Nov 14 04:55:07 user nova-compute[75469]:     <interface type='ethernet'>
Nov 14 04:55:07 user nova-compute[75469]:       <mac address='fa:16:3e:b1:29:fb'/>
Nov 14 04:55:07 user nova-compute[75469]:       <target dev='tapa5d80c3d-3d'/>
Nov 14 04:55:07 user nova-compute[75469]:       <model type='virtio'/>
Nov 14 04:55:07 user nova-compute[75469]:       <mtu size='1442'/>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='net0'/>
Nov 14 04:55:07 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 04:55:07 user nova-compute[75469]:     </interface>
Nov 14 04:55:07 user nova-compute[75469]:     <serial type='pty'>
Nov 14 04:55:07 user nova-compute[75469]:       <source path='/dev/pts/10'/>
Nov 14 04:55:07 user nova-compute[75469]:       <log file='/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/console.log' append='off'/>
Nov 14 04:55:07 user nova-compute[75469]:       <target type='isa-serial' port='0'>
Nov 14 04:55:07 user nova-compute[75469]:         <model name='isa-serial'/>
Nov 14 04:55:07 user nova-compute[75469]:       </target>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='serial0'/>
Nov 14 04:55:07 user nova-compute[75469]:     </serial>
Nov 14 04:55:07 user nova-compute[75469]:     <console type='pty' tty='/dev/pts/10'>
Nov 14 04:55:07 user nova-compute[75469]:       <source path='/dev/pts/10'/>
Nov 14 04:55:07 user nova-compute[75469]:       <log file='/opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12/console.log' append='off'/>
Nov 14 04:55:07 user nova-compute[75469]:       <target type='serial' port='0'/>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='serial0'/>
Nov 14 04:55:07 user nova-compute[75469]:     </console>
Nov 14 04:55:07 user nova-compute[75469]:     <input type='mouse' bus='ps2'>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='input0'/>
Nov 14 04:55:07 user nova-compute[75469]:     </input>
Nov 14 04:55:07 user nova-compute[75469]:     <input type='keyboard' bus='ps2'>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='input1'/>
Nov 14 04:55:07 user nova-compute[75469]:     </input>
Nov 14 04:55:07 user nova-compute[75469]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 14 04:55:07 user nova-compute[75469]:       <listen type='address' address='0.0.0.0'/>
Nov 14 04:55:07 user nova-compute[75469]:     </graphics>
Nov 14 04:55:07 user nova-compute[75469]:     <audio id='1' type='none'/>
Nov 14 04:55:07 user nova-compute[75469]:     <video>
Nov 14 04:55:07 user nova-compute[75469]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='video0'/>
Nov 14 04:55:07 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 04:55:07 user nova-compute[75469]:     </video>
Nov 14 04:55:07 user nova-compute[75469]:     <memballoon model='virtio'>
Nov 14 04:55:07 user nova-compute[75469]:       <stats period='10'/>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='balloon0'/>
Nov 14 04:55:07 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 04:55:07 user nova-compute[75469]:     </memballoon>
Nov 14 04:55:07 user nova-compute[75469]:     <rng model='virtio'>
Nov 14 04:55:07 user nova-compute[75469]:       <backend model='random'>/dev/urandom</backend>
Nov 14 04:55:07 user nova-compute[75469]:       <alias name='rng0'/>
Nov 14 04:55:07 user nova-compute[75469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 04:55:07 user nova-compute[75469]:     </rng>
Nov 14 04:55:07 user nova-compute[75469]:   </devices>
Nov 14 04:55:07 user nova-compute[75469]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 04:55:07 user nova-compute[75469]:     <label>libvirt-c32dcf16-daa4-4370-be69-ebeba12e2b12</label>
Nov 14 04:55:07 user nova-compute[75469]:     <imagelabel>libvirt-c32dcf16-daa4-4370-be69-ebeba12e2b12</imagelabel>
Nov 14 04:55:07 user nova-compute[75469]:   </seclabel>
Nov 14 04:55:07 user nova-compute[75469]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 04:55:07 user nova-compute[75469]:     <label>+64055:+108</label>
Nov 14 04:55:07 user nova-compute[75469]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 04:55:07 user nova-compute[75469]:   </seclabel>
Nov 14 04:55:07 user nova-compute[75469]: </domain>
Nov 14 04:55:07 user nova-compute[75469]:  {{(pid=75469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 04:55:07 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Successfully detached device tap079c1d45-5d from instance c32dcf16-daa4-4370-be69-ebeba12e2b12 from the live domain config.
Nov 14 04:55:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-4526189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-4526189',id=10,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO++5P4KL/ZlD2ZzykOgGS1QHT6rp4SrhnI8T9uGc2ieskb1Zpm1kRlcju/ARTYmnDKlMLY/nhtyrzPX47AoyAGkHDc3X9h1UXq82L6/7cPAy7R2c05pO9fh3r7p59j+EA==',key_name='tempest-keypair-1149227935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cab74b837d742b2bf746eaf0f8a8d5f',ramdisk_id='',reservation_id='r-r4mmdsm7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1158979709',owner_user_name='tempest-TaggedAttachmentsTest-1158979709-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4371d2e15d6486b8b6aafd72905b1e5',uuid=c32dcf16-daa4-4370-be69-ebeba12e2b12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "079c1d45-5dc2-493b-b3cd-27433bb99386", "address": "fa:16:3e:47:84:56", "network": {"id": "53b318a2-3540-4714-95db-1e1a1ccaf111", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1699408991", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079c1d45-5d", "ovs_interfaceid": "079c1d45-5dc2-493b-b3cd-27433bb99386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converting VIF {"id": "079c1d45-5dc2-493b-b3cd-27433bb99386", "address": "fa:16:3e:47:84:56", "network": {"id": "53b318a2-3540-4714-95db-1e1a1ccaf111", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1699408991", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079c1d45-5d", "ovs_interfaceid": "079c1d45-5dc2-493b-b3cd-27433bb99386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:84:56,bridge_name='br-int',has_traffic_filtering=True,id=079c1d45-5dc2-493b-b3cd-27433bb99386,network=Network(53b318a2-3540-4714-95db-1e1a1ccaf111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079c1d45-5d') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG os_vif [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:84:56,bridge_name='br-int',has_traffic_filtering=True,id=079c1d45-5dc2-493b-b3cd-27433bb99386,network=Network(53b318a2-3540-4714-95db-1e1a1ccaf111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079c1d45-5d') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap079c1d45-5d, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=727a7b1d-3adc-4835-8807-bb91d463e389) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:07 user nova-compute[75469]: INFO os_vif [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:84:56,bridge_name='br-int',has_traffic_filtering=True,id=079c1d45-5dc2-493b-b3cd-27433bb99386,network=Network(53b318a2-3540-4714-95db-1e1a1ccaf111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079c1d45-5d')
Nov 14 04:55:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:55:07 user nova-compute[75469]:   <nova:package version="0.0.0"/>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:name>tempest-device-tagging-server-4526189</nova:name>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:creationTime>2023-11-14 04:55:07</nova:creationTime>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:flavor name="m1.tiny">
Nov 14 04:55:07 user nova-compute[75469]:     <nova:memory>512</nova:memory>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:disk>1</nova:disk>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:swap>0</nova:swap>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:vcpus>1</nova:vcpus>
Nov 14 04:55:07 user nova-compute[75469]:   </nova:flavor>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:owner>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:user uuid="c4371d2e15d6486b8b6aafd72905b1e5">tempest-TaggedAttachmentsTest-1158979709-project-member</nova:user>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:project uuid="4cab74b837d742b2bf746eaf0f8a8d5f">tempest-TaggedAttachmentsTest-1158979709</nova:project>
Nov 14 04:55:07 user nova-compute[75469]:   </nova:owner>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:55:07 user nova-compute[75469]:   <nova:ports>
Nov 14 04:55:07 user nova-compute[75469]:     <nova:port uuid="a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f">
Nov 14 04:55:07 user nova-compute[75469]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 04:55:07 user nova-compute[75469]:     </nova:port>
Nov 14 04:55:07 user nova-compute[75469]:   </nova:ports>
Nov 14 04:55:07 user nova-compute[75469]: </nova:instance>
Nov 14 04:55:07 user nova-compute[75469]:  {{(pid=75469) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 04:55:08 user nova-compute[75469]: DEBUG nova.objects.instance [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lazy-loading 'flavor' on Instance uuid 1ab6379f-1ffa-4852-a00f-b498b39a2f3d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-aa574e51-90b7-4eea-8449-6b38bada61f1 tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.106s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:55:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquired lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:55:08 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:55:08 user nova-compute[75469]: INFO nova.network.neutron [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Port 079c1d45-5dc2-493b-b3cd-27433bb99386 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 14 04:55:08 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Updating instance_info_cache with network_info: [{"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Releasing lock "refresh_cache-c32dcf16-daa4-4370-be69-ebeba12e2b12" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ea7ce707-bfa6-4171-842a-5bd02139c08f tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "interface-c32dcf16-daa4-4370-be69-ebeba12e2b12-079c1d45-5dc2-493b-b3cd-27433bb99386" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.810s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:55:09 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Instance spawned successfully.
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:55:09 user nova-compute[75469]: INFO nova.compute.manager [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:55:09 user nova-compute[75469]: INFO nova.compute.manager [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Took 6.02 seconds to build instance.
Nov 14 04:55:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8c12b676-af31-4b0c-b3ce-7c698ae1c866 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.123s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-40225747-d7ea-453d-ba91-129c47c9806e req-27f2600f-2cd4-44de-8ae2-9c1f6bed6cb9 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Received event network-vif-plugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-40225747-d7ea-453d-ba91-129c47c9806e req-27f2600f-2cd4-44de-8ae2-9c1f6bed6cb9 service nova] Acquiring lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-40225747-d7ea-453d-ba91-129c47c9806e req-27f2600f-2cd4-44de-8ae2-9c1f6bed6cb9 service nova] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-40225747-d7ea-453d-ba91-129c47c9806e req-27f2600f-2cd4-44de-8ae2-9c1f6bed6cb9 service nova] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-40225747-d7ea-453d-ba91-129c47c9806e req-27f2600f-2cd4-44de-8ae2-9c1f6bed6cb9 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] No waiting events found dispatching network-vif-plugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:09 user nova-compute[75469]: WARNING nova.compute.manager [req-40225747-d7ea-453d-ba91-129c47c9806e req-27f2600f-2cd4-44de-8ae2-9c1f6bed6cb9 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Received unexpected event network-vif-plugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c for instance with vm_state active and task_state None.
Nov 14 04:55:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-40225747-d7ea-453d-ba91-129c47c9806e req-27f2600f-2cd4-44de-8ae2-9c1f6bed6cb9 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-vif-deleted-079c1d45-5dc2-493b-b3cd-27433bb99386 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Acquiring lock "42daead3-8494-429a-8915-cb88ad87496a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "42daead3-8494-429a-8915-cb88ad87496a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Acquiring lock "42daead3-8494-429a-8915-cb88ad87496a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "42daead3-8494-429a-8915-cb88ad87496a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "42daead3-8494-429a-8915-cb88ad87496a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:22 user nova-compute[75469]: INFO nova.compute.manager [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Terminating instance
Nov 14 04:55:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-294889cd-6350-45ea-ac96-1e44094cd6f0 req-1713a20e-7f3a-42da-9590-1d64083f029f service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Received event network-vif-unplugged-679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-294889cd-6350-45ea-ac96-1e44094cd6f0 req-1713a20e-7f3a-42da-9590-1d64083f029f service nova] Acquiring lock "42daead3-8494-429a-8915-cb88ad87496a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-294889cd-6350-45ea-ac96-1e44094cd6f0 req-1713a20e-7f3a-42da-9590-1d64083f029f service nova] Lock "42daead3-8494-429a-8915-cb88ad87496a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-294889cd-6350-45ea-ac96-1e44094cd6f0 req-1713a20e-7f3a-42da-9590-1d64083f029f service nova] Lock "42daead3-8494-429a-8915-cb88ad87496a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-294889cd-6350-45ea-ac96-1e44094cd6f0 req-1713a20e-7f3a-42da-9590-1d64083f029f service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] No waiting events found dispatching network-vif-unplugged-679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-294889cd-6350-45ea-ac96-1e44094cd6f0 req-1713a20e-7f3a-42da-9590-1d64083f029f service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Received event network-vif-unplugged-679bdb9b-cea2-4445-95b1-ea3238205986 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:55:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Instance destroyed successfully.
Nov 14 04:55:23 user nova-compute[75469]: DEBUG nova.objects.instance [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lazy-loading 'resources' on Instance uuid 42daead3-8494-429a-8915-cb88ad87496a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1946636263',display_name='tempest-VolumesAssistedSnapshotsTest-server-1946636263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1946636263',id=11,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1WYzuNiyWzFgqHkwD6n0iGngsOwh0/iiAmJwLfqOPuhfmnV19jp7xtxx1R+6WRqxp2oxLft6mx5MD2EI/z2F7QCDWPTN3ps+XcizG8xof7Ee7D6PVDzQXHOOnI4DQbOQ==',key_name='tempest-keypair-1353956079',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2376409c2e1f48caaf8e8c8b806a9d87',ramdisk_id='',reservation_id='r-uu0bw7b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-142379938',owner_user_name='tempest-VolumesAssistedSnapshotsTest-142379938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b4e5d135f549218fc26afeb51f0ebe',uuid=42daead3-8494-429a-8915-cb88ad87496a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "679bdb9b-cea2-4445-95b1-ea3238205986", "address": "fa:16:3e:3c:20:95", "network": {"id": "36c1ae2e-640a-4264-81a8-398fc34f70d4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1580795687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2376409c2e1f48caaf8e8c8b806a9d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679bdb9b-ce", "ovs_interfaceid": "679bdb9b-cea2-4445-95b1-ea3238205986", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Converting VIF {"id": "679bdb9b-cea2-4445-95b1-ea3238205986", "address": "fa:16:3e:3c:20:95", "network": {"id": "36c1ae2e-640a-4264-81a8-398fc34f70d4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1580795687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2376409c2e1f48caaf8e8c8b806a9d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679bdb9b-ce", "ovs_interfaceid": "679bdb9b-cea2-4445-95b1-ea3238205986", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:20:95,bridge_name='br-int',has_traffic_filtering=True,id=679bdb9b-cea2-4445-95b1-ea3238205986,network=Network(36c1ae2e-640a-4264-81a8-398fc34f70d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679bdb9b-ce') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG os_vif [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:20:95,bridge_name='br-int',has_traffic_filtering=True,id=679bdb9b-cea2-4445-95b1-ea3238205986,network=Network(36c1ae2e-640a-4264-81a8-398fc34f70d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679bdb9b-ce') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap679bdb9b-ce, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e48c3505-5a36-4278-bdda-5b8f14bc106c) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:23 user nova-compute[75469]: INFO os_vif [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:20:95,bridge_name='br-int',has_traffic_filtering=True,id=679bdb9b-cea2-4445-95b1-ea3238205986,network=Network(36c1ae2e-640a-4264-81a8-398fc34f70d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679bdb9b-ce')
Nov 14 04:55:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Deleting instance files /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a_del
Nov 14 04:55:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Deletion of /opt/stack/data/nova/instances/42daead3-8494-429a-8915-cb88ad87496a_del complete
Nov 14 04:55:23 user nova-compute[75469]: INFO nova.compute.manager [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 14 04:55:23 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:55:23 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 42daead3-8494-429a-8915-cb88ad87496a] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:55:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-c6acb82f-9254-4f9c-8dd9-89a297a914be req-d6a6e2b7-79c6-4888-9934-4bf5d05e7918 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Received event network-vif-plugged-679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c6acb82f-9254-4f9c-8dd9-89a297a914be req-d6a6e2b7-79c6-4888-9934-4bf5d05e7918 service nova] Acquiring lock "42daead3-8494-429a-8915-cb88ad87496a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c6acb82f-9254-4f9c-8dd9-89a297a914be req-d6a6e2b7-79c6-4888-9934-4bf5d05e7918 service nova] Lock "42daead3-8494-429a-8915-cb88ad87496a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c6acb82f-9254-4f9c-8dd9-89a297a914be req-d6a6e2b7-79c6-4888-9934-4bf5d05e7918 service nova] Lock "42daead3-8494-429a-8915-cb88ad87496a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-c6acb82f-9254-4f9c-8dd9-89a297a914be req-d6a6e2b7-79c6-4888-9934-4bf5d05e7918 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] No waiting events found dispatching network-vif-plugged-679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:24 user nova-compute[75469]: WARNING nova.compute.manager [req-c6acb82f-9254-4f9c-8dd9-89a297a914be req-d6a6e2b7-79c6-4888-9934-4bf5d05e7918 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Received unexpected event network-vif-plugged-679bdb9b-cea2-4445-95b1-ea3238205986 for instance with vm_state active and task_state deleting.
Nov 14 04:55:24 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:24 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Took 1.54 seconds to deallocate network for instance.
Nov 14 04:55:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:25 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:55:25 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:55:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:25 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Deleted allocations for instance 42daead3-8494-429a-8915-cb88ad87496a
Nov 14 04:55:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1bc13a72-ab1c-44ad-b39a-01c3d8e94ef0 tempest-VolumesAssistedSnapshotsTest-142379938 tempest-VolumesAssistedSnapshotsTest-142379938-project-member] Lock "42daead3-8494-429a-8915-cb88ad87496a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.206s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-92116ae2-6d93-450c-9a26-e755ea6417b9 req-0bff006b-3ff9-493f-a5d9-ef8118743a13 service nova] [instance: 42daead3-8494-429a-8915-cb88ad87496a] Received event network-vif-deleted-679bdb9b-cea2-4445-95b1-ea3238205986 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:36 user nova-compute[75469]: INFO nova.compute.manager [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Terminating instance
Nov 14 04:55:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:55:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:37 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Instance destroyed successfully.
Nov 14 04:55:37 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lazy-loading 'resources' on Instance uuid 1ab6379f-1ffa-4852-a00f-b498b39a2f3d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-b23d9c70-660f-40b5-92d9-6e51f77a6909 req-cb0af9f7-cb4b-46fc-8149-16eaddbbe6cb service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Received event network-vif-unplugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b23d9c70-660f-40b5-92d9-6e51f77a6909 req-cb0af9f7-cb4b-46fc-8149-16eaddbbe6cb service nova] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b23d9c70-660f-40b5-92d9-6e51f77a6909 req-cb0af9f7-cb4b-46fc-8149-16eaddbbe6cb service nova] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b23d9c70-660f-40b5-92d9-6e51f77a6909 req-cb0af9f7-cb4b-46fc-8149-16eaddbbe6cb service nova] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-b23d9c70-660f-40b5-92d9-6e51f77a6909 req-cb0af9f7-cb4b-46fc-8149-16eaddbbe6cb service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] No waiting events found dispatching network-vif-unplugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-b23d9c70-660f-40b5-92d9-6e51f77a6909 req-cb0af9f7-cb4b-46fc-8149-16eaddbbe6cb service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Received event network-vif-unplugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1205160601',display_name='tempest-TestVolumeSwap-server-1205160601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1205160601',id=8,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNViujSJDjP/tT6peMSsz24C2nYQ2Z7p08qPmVAAz4Y1ONWyTtsLK5IRoIWaQbvOTSzXRVQkXaKN/2caeYtJPrftygLjZG58HLKDGkrq0LdjRhgPh0+4JzxkRTYjjIerw==',key_name='tempest-keypair-439817151',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dc8d826c76141c092339f38b74c6f79',ramdisk_id='',reservation_id='r-0d0t2q1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-481268122',owner_user_name='tempest-TestVolumeSwap-481268122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a159887ca76a474cad961ff2e63160de',uuid=1ab6379f-1ffa-4852-a00f-b498b39a2f3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "address": "fa:16:3e:1c:55:ea", "network": {"id": "3e46277e-112a-447b-931b-653305d97318", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1114632681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc8d826c76141c092339f38b74c6f79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f088f44-a1", "ovs_interfaceid": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Converting VIF {"id": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "address": "fa:16:3e:1c:55:ea", "network": {"id": "3e46277e-112a-447b-931b-653305d97318", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1114632681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc8d826c76141c092339f38b74c6f79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f088f44-a1", "ovs_interfaceid": "5f088f44-a1a0-43b4-80de-4dfb8f0480ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:55:ea,bridge_name='br-int',has_traffic_filtering=True,id=5f088f44-a1a0-43b4-80de-4dfb8f0480ae,network=Network(3e46277e-112a-447b-931b-653305d97318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f088f44-a1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG os_vif [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:55:ea,bridge_name='br-int',has_traffic_filtering=True,id=5f088f44-a1a0-43b4-80de-4dfb8f0480ae,network=Network(3e46277e-112a-447b-931b-653305d97318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f088f44-a1') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f088f44-a1, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9293fc04-70d3-40c4-bd3b-cbab3f288759) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:37 user nova-compute[75469]: INFO os_vif [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:55:ea,bridge_name='br-int',has_traffic_filtering=True,id=5f088f44-a1a0-43b4-80de-4dfb8f0480ae,network=Network(3e46277e-112a-447b-931b-653305d97318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f088f44-a1')
Nov 14 04:55:37 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Deleting instance files /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d_del
Nov 14 04:55:37 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Deletion of /opt/stack/data/nova/instances/1ab6379f-1ffa-4852-a00f-b498b39a2f3d_del complete
Nov 14 04:55:37 user nova-compute[75469]: INFO nova.compute.manager [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 04:55:37 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:55:37 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:38 user nova-compute[75469]: INFO nova.compute.manager [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Terminating instance
Nov 14 04:55:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG nova.objects.instance [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lazy-loading 'flavor' on Instance uuid fb551839-7b5a-4ecd-b9c0-ab53addeaa45 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:38 user nova-compute[75469]: INFO nova.compute.manager [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Attaching volume 3fc11541-4c2d-4184-bee8-29391718e188 to /dev/vdb
Nov 14 04:55:38 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:38 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Took 1.51 seconds to deallocate network for instance.
Nov 14 04:55:38 user nova-compute[75469]: DEBUG os_brick.utils [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94534cde-0c23-4aad-9029-5413b68b3a12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a299a7e1-82a8-4b15-ab97-14a5082abd8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edd2a6e-7727-482d-8d40-a7116193baea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3940903f-9ca0-40b3-93f5-0f3edc1702b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:55:39 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[882238de-094b-4e10-a0a0-6450026174ed]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG os_brick.utils [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating existing volume attachment record: 82d10969-a113-4397-9409-b926dcddd10d {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:55:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Instance destroyed successfully.
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.objects.instance [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lazy-loading 'resources' on Instance uuid c32dcf16-daa4-4370-be69-ebeba12e2b12 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-4526189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-4526189',id=10,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO++5P4KL/ZlD2ZzykOgGS1QHT6rp4SrhnI8T9uGc2ieskb1Zpm1kRlcju/ARTYmnDKlMLY/nhtyrzPX47AoyAGkHDc3X9h1UXq82L6/7cPAy7R2c05pO9fh3r7p59j+EA==',key_name='tempest-keypair-1149227935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cab74b837d742b2bf746eaf0f8a8d5f',ramdisk_id='',reservation_id='r-r4mmdsm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1158979709',owner_user_name='tempest-TaggedAttachmentsTest-1158979709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4371d2e15d6486b8b6aafd72905b1e5',uuid=c32dcf16-daa4-4370-be69-ebeba12e2b12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converting VIF {"id": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "address": "fa:16:3e:b1:29:fb", "network": {"id": "3bcf780a-1e9b-482a-919a-6145b57f7a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1513204307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cab74b837d742b2bf746eaf0f8a8d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d80c3d-3d", "ovs_interfaceid": "a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:29:fb,bridge_name='br-int',has_traffic_filtering=True,id=a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f,network=Network(3bcf780a-1e9b-482a-919a-6145b57f7a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d80c3d-3d') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG os_vif [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:29:fb,bridge_name='br-int',has_traffic_filtering=True,id=a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f,network=Network(3bcf780a-1e9b-482a-919a-6145b57f7a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d80c3d-3d') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5d80c3d-3d, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5c793ab-843d-4a3a-b6ab-ad598e702255) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:39 user nova-compute[75469]: INFO os_vif [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:29:fb,bridge_name='br-int',has_traffic_filtering=True,id=a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f,network=Network(3bcf780a-1e9b-482a-919a-6145b57f7a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d80c3d-3d')
Nov 14 04:55:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Deleting instance files /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12_del
Nov 14 04:55:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Deletion of /opt/stack/data/nova/instances/c32dcf16-daa4-4370-be69-ebeba12e2b12_del complete
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Received event network-vif-plugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] Acquiring lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] No waiting events found dispatching network-vif-plugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:39 user nova-compute[75469]: WARNING nova.compute.manager [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Received unexpected event network-vif-plugged-5f088f44-a1a0-43b4-80de-4dfb8f0480ae for instance with vm_state deleted and task_state None.
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-vif-unplugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] No waiting events found dispatching network-vif-unplugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-vif-unplugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] [instance: 1ab6379f-1ffa-4852-a00f-b498b39a2f3d] Received event network-vif-deleted-5f088f44-a1a0-43b4-80de-4dfb8f0480ae {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-vif-plugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] Acquiring lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] No waiting events found dispatching network-vif-plugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:39 user nova-compute[75469]: WARNING nova.compute.manager [req-eb543e3c-d0fe-4f19-9516-54825200f6d0 req-95435520-879f-4ff7-a86b-055a1eca67ce service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received unexpected event network-vif-plugged-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f for instance with vm_state active and task_state deleting.
Nov 14 04:55:39 user nova-compute[75469]: INFO nova.compute.manager [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:39 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Deleted allocations for instance 1ab6379f-1ffa-4852-a00f-b498b39a2f3d
Nov 14 04:55:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3bc12485-ebdd-4828-8b42-fed60c604e8b tempest-TestVolumeSwap-481268122 tempest-TestVolumeSwap-481268122-project-member] Lock "1ab6379f-1ffa-4852-a00f-b498b39a2f3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.181s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:40 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:40 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Took 1.19 seconds to deallocate network for instance.
Nov 14 04:55:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:40 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:55:40 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:55:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:41 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Deleted allocations for instance c32dcf16-daa4-4370-be69-ebeba12e2b12
Nov 14 04:55:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-452e0117-864e-45e0-824a-6f974903a6cd tempest-TaggedAttachmentsTest-1158979709 tempest-TaggedAttachmentsTest-1158979709-project-member] Lock "c32dcf16-daa4-4370-be69-ebeba12e2b12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.772s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-e15c7d84-7ced-4e64-a1e6-adbee2e72700 req-47a7c910-7bc5-431d-86c3-f90ae3f72a65 service nova] [instance: c32dcf16-daa4-4370-be69-ebeba12e2b12] Received event network-vif-deleted-a5d80c3d-3d85-46b3-a0c2-5da73ead7c9f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:42 user nova-compute[75469]: INFO nova.compute.manager [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Unshelving
Nov 14 04:55:42 user nova-compute[75469]: INFO nova.virt.block_device [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Booting with volume d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 at /dev/vdc
Nov 14 04:55:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG os_brick.utils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c06910b-b8a0-4ff5-ac9f-d5491308290c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[451d7301-51c7-4ce3-9009-357394489478]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c09ae7e-9ce2-45e9-b945-236a8268f89c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecb171f-c3c5-4257-a0e2-fe259ae84a4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:55:42 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:55:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b646a89b-2c30-4b08-b31b-0bb41220108e]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG os_brick.utils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:55:42 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating existing volume attachment record: 03a00b9c-882d-4fcf-94d7-aa4ac7af96ac {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knptGdZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:55:43 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:55:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:55:43 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:55:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:55:43 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[575ae5ba-a991-498a-b7c8-930e8314e9f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:55:43 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a99e20d-a867-4f88-a900-a2c48344eae9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188] added
Nov 14 04:55:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[993b3de4-0971-4d65-85cf-93e1480d08df]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[226f359f-43a7-45c2-a8a8-8b6374f175d4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knptGdZo {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knptGdZo" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a40d25a-1e06-46ff-b26d-67fe388e6a42]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'knptGdZo'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb09eb72-d637-45d5-a606-4d221f48cc8a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1890309b-ff52-4d5e-a11c-57ed5fc5b6b4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:44 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:44 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:44 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:44 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd6d4da-e95f-4901-8375-dd8d9a2d1363]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]
Nov 14 04:55:44 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.
Nov 14 04:55:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14a5781-898e-4b7a-a161-eae387ea6ea7]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc424981-d986-49f2-99e2-6159fd6734ac]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:44 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:44 user nova-compute[75469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:55:44 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:44 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:44 user nova-compute[75469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:55:44 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aa9d49-77ba-4a3e-8672-8087b4b71bde]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knptGdZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquired lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG nova.network.neutron [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'info_cache' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:44 user nova-compute[75469]: DEBUG nova.objects.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23466663565613362', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466663565613362', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG nova.objects.instance [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lazy-loading 'flavor' on Instance uuid fb551839-7b5a-4ecd-b9c0-ab53addeaa45 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:55:45 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:55:45 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 04:55:45 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:55:45 user nova-compute[75469]:   <serial>3fc11541-4c2d-4184-bee8-29391718e188</serial>
Nov 14 04:55:45 user nova-compute[75469]: </disk>
Nov 14 04:55:45 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] No VIF found with MAC fa:16:3e:44:d1:3e, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:55:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50f8ecec-ba30-433f-8279-7a101bc35500 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.136s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updating instance_info_cache with network_info: [{"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Releasing lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:55:46 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance destroyed successfully.
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'resources' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.objects.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1216043162',display_name='tempest-AttachVolumeTestJSON-server-1216043162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1216043162',id=3,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmvdCBIfh48Eeknk9EcyhY/EUByia8dNJsdA49UBgYl79YeoAE1ZBCnXslVyMxP+0apbX7EEDT0C15puJDnVXndeeRGIR/eT6s8JeH6vqhOdqMbAiRlzvoMhvGWyeiHSA==',key_name='tempest-keypair-539876909',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-s5b510vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=68c68428-4d79-4dd7-94a1-9c05e5230a8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_vif [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d0308df-4e, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7175debc-ec19-43d8-8a53-c8fe00c3bde9) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:46 user nova-compute[75469]: INFO os_vif [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e')
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIhwqitL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:55:46 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bf19e4-3792-491e-91b9-8fcdb7bb1d26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:55:46 user nova-compute[75469]: No targets found.
Nov 14 04:55:46 user nova-compute[75469]: iSNS:
Nov 14 04:55:46 user nova-compute[75469]: No targets found.
Nov 14 04:55:46 user nova-compute[75469]: STATIC:
Nov 14 04:55:46 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188
Nov 14 04:55:46 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:46 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:46 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:55:46 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:46 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:46 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:55:46 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:46 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:46 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 04:55:46 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:46 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:46 user nova-compute[75469]: FIRMWARE:
Nov 14 04:55:46 user nova-compute[75469]: No targets found.
Nov 14 04:55:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:55:46 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:55:46 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7404387e-d37f-4f7f-b78c-613b47d6bb42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f7b7c3-c1ba-4ef1-aef2-068ac6a04f98]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:46 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:46 user nova-compute[75469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:55:46 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:46 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:46 user nova-compute[75469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:55:46 user nova-compute[75469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7504c1ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4'): ({'sdf'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Removing single pathed devices sdf {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8279f468-1783-4897-8ad0-3268c630deef]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef54af1d-8fa9-4d2d-9229-91be11e8a0ad]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flushing IO for device /dev/sdf {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9fac30-b730-4df9-8125-0d3b06840af6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1305b8-560e-49d6-824f-269fa5a7f582]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] SCSI volumes sdf have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a941e8bc-efbd-4a23-83a8-2078c371435d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c227fd3-b949-484d-8dae-0edf72505ed8]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260]
Nov 14 04:55:46 user nova-compute[75469]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260] successful.
Nov 14 04:55:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b72cfdf-fa34-4e9d-ae2a-3478faf604ff]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] <== disconnect_volume: return (315ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Start _get_guest_xml network_info=[{"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '0db4ebb0-041f-47ef-ae4b-206bc2b2d0f4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIhwqitL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '68c68428-4d79-4dd7-94a1-9c05e5230a8a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0c5f86b-996a-4683-90a1-2da62e9d51f4', 'serial': 'a0c5f86b-996a-4683-90a1-2da62e9d51f4'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'numa_topology' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.objects.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating instance_info_cache with network_info: [{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:46 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:55:46 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.objects.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIhwqitL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:55:46 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:55:46 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:55:46 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2006ea8-e101-4ac6-baaa-9b95b5e3788c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:55:46 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9a7523-d8ed-4c87-aaa6-8af7a65688a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4] added
Nov 14 04:55:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ff84d7-f262-4c77-ba14-705d847a801e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec480dd-fa09-44ed-8cfd-95c05e90203a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIhwqitL {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIhwqitL" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f11716-b1a3-408a-b647-e935e0ce8b97]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CIhwqitL'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f76184e-33e8-470b-b91d-3233e969619a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f182377-f628-4852-b896-9fd84555343a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:46 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:46 user nova-compute[75469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:55:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:46 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:46 user nova-compute[75469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:55:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[44866f1d-4969-48f1-977f-6fa32dfe6667]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260]
Nov 14 04:55:46 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260] successful.
Nov 14 04:55:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b28abd-b98c-4d38-b128-8e6cb48e1eaa]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c85d9ba-b88c-4484-8223-058937d692ec]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:47 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:47 user nova-compute[75469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:55:47 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:47 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:47 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:47 user nova-compute[75469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:55:47 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:47 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42f630d-af71-4952-8efa-dd3c441e178b]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIhwqitL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'pci_requests' on Instance uuid fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'numa_topology' on Instance uuid fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:55:47 user nova-compute[75469]: INFO nova.compute.claims [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Claim successful on node user
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23762303430633430', 'path': '/dev/sdd'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762303430633430', 'path': '/dev/sdd'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1216043162',display_name='tempest-AttachVolumeTestJSON-server-1216043162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1216043162',id=3,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmvdCBIfh48Eeknk9EcyhY/EUByia8dNJsdA49UBgYl79YeoAE1ZBCnXslVyMxP+0apbX7EEDT0C15puJDnVXndeeRGIR/eT6s8JeH6vqhOdqMbAiRlzvoMhvGWyeiHSA==',key_name='tempest-keypair-539876909',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-s5b510vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=68c68428-4d79-4dd7-94a1-9c05e5230a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'pci_devices' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.objects.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:55:48 user nova-compute[75469]:   <uuid>68c68428-4d79-4dd7-94a1-9c05e5230a8a</uuid>
Nov 14 04:55:48 user nova-compute[75469]:   <name>instance-00000003</name>
Nov 14 04:55:48 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:55:48 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:55:48 user nova-compute[75469]:   <metadata>
Nov 14 04:55:48 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:55:48 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:55:48 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeTestJSON-server-1216043162</nova:name>
Nov 14 04:55:48 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:55:46</nova:creationTime>
Nov 14 04:55:48 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:55:48 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:55:48 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:55:48 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:55:48 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:55:48 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:55:48 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:55:48 user nova-compute[75469]:       <nova:owner>
Nov 14 04:55:48 user nova-compute[75469]:         <nova:user uuid="3142f0a24ee841878d06e14817fa1f86">tempest-AttachVolumeTestJSON-2079958443-project-member</nova:user>
Nov 14 04:55:48 user nova-compute[75469]:         <nova:project uuid="f7e85721ebed4cccaecde59d1944cd64">tempest-AttachVolumeTestJSON-2079958443</nova:project>
Nov 14 04:55:48 user nova-compute[75469]:       </nova:owner>
Nov 14 04:55:48 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:55:48 user nova-compute[75469]:       <nova:ports>
Nov 14 04:55:48 user nova-compute[75469]:         <nova:port uuid="5d0308df-4ec4-495c-b85e-73900b018564">
Nov 14 04:55:48 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 04:55:48 user nova-compute[75469]:         </nova:port>
Nov 14 04:55:48 user nova-compute[75469]:       </nova:ports>
Nov 14 04:55:48 user nova-compute[75469]:     </nova:instance>
Nov 14 04:55:48 user nova-compute[75469]:   </metadata>
Nov 14 04:55:48 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:55:48 user nova-compute[75469]:     <system>
Nov 14 04:55:48 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:55:48 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:55:48 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:55:48 user nova-compute[75469]:       <entry name="serial">68c68428-4d79-4dd7-94a1-9c05e5230a8a</entry>
Nov 14 04:55:48 user nova-compute[75469]:       <entry name="uuid">68c68428-4d79-4dd7-94a1-9c05e5230a8a</entry>
Nov 14 04:55:48 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:55:48 user nova-compute[75469]:     </system>
Nov 14 04:55:48 user nova-compute[75469]:   </sysinfo>
Nov 14 04:55:48 user nova-compute[75469]:   <os>
Nov 14 04:55:48 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:55:48 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:55:48 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:55:48 user nova-compute[75469]:   </os>
Nov 14 04:55:48 user nova-compute[75469]:   <features>
Nov 14 04:55:48 user nova-compute[75469]:     <acpi/>
Nov 14 04:55:48 user nova-compute[75469]:     <apic/>
Nov 14 04:55:48 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:55:48 user nova-compute[75469]:   </features>
Nov 14 04:55:48 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:55:48 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:55:48 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:55:48 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:55:48 user nova-compute[75469]:   </clock>
Nov 14 04:55:48 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:55:48 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:55:48 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:55:48 user nova-compute[75469]:   </cpu>
Nov 14 04:55:48 user nova-compute[75469]:   <devices>
Nov 14 04:55:48 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:55:48 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:55:48 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk"/>
Nov 14 04:55:48 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:55:48 user nova-compute[75469]:     </disk>
Nov 14 04:55:48 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:55:48 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:55:48 user nova-compute[75469]:       <source dev="/dev/sdd"/>
Nov 14 04:55:48 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 04:55:48 user nova-compute[75469]:       <serial>a0c5f86b-996a-4683-90a1-2da62e9d51f4</serial>
Nov 14 04:55:48 user nova-compute[75469]:     </disk>
Nov 14 04:55:48 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:55:48 user nova-compute[75469]:       <mac address="fa:16:3e:de:a7:a6"/>
Nov 14 04:55:48 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:55:48 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:55:48 user nova-compute[75469]:       <target dev="tap5d0308df-4e"/>
Nov 14 04:55:48 user nova-compute[75469]:     </interface>
Nov 14 04:55:48 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:55:48 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/console.log" append="off"/>
Nov 14 04:55:48 user nova-compute[75469]:     </serial>
Nov 14 04:55:48 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:55:48 user nova-compute[75469]:     <video>
Nov 14 04:55:48 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:55:48 user nova-compute[75469]:     </video>
Nov 14 04:55:48 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:55:48 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:55:48 user nova-compute[75469]:     </rng>
Nov 14 04:55:48 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:55:48 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:55:48 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:55:48 user nova-compute[75469]:     </memballoon>
Nov 14 04:55:48 user nova-compute[75469]:   </devices>
Nov 14 04:55:48 user nova-compute[75469]: </domain>
Nov 14 04:55:48 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Stashing vm_state: active {{(pid=75469) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:48 user nova-compute[75469]: INFO nova.network.neutron [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating port d5b49c15-8461-4b3c-aa57-0dcdd7b12305 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.objects.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:55:48 user nova-compute[75469]: INFO nova.compute.claims [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Claim successful on node user
Nov 14 04:55:48 user nova-compute[75469]: INFO nova.compute.resource_tracker [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating resource usage from migration e209f1ff-4fff-46a3-8c86-bd11e783e5d2
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.205s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquired lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.network.neutron [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-4e34aecf-8839-4041-aac1-60828847e930 req-3d9e5369-d0fc-4260-8438-b2d86de042f1 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-changed-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-4e34aecf-8839-4041-aac1-60828847e930 req-3d9e5369-d0fc-4260-8438-b2d86de042f1 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Refreshing instance network info cache due to event network-changed-d5b49c15-8461-4b3c-aa57-0dcdd7b12305. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4e34aecf-8839-4041-aac1-60828847e930 req-3d9e5369-d0fc-4260-8438-b2d86de042f1 service nova] Acquiring lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.775s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Cannot resize image /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'migration_context' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:49 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:55:49 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8161MB free_disk=25.372196197509766GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.objects.base [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1216043162',display_name='tempest-AttachVolumeTestJSON-server-1216043162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1216043162',id=3,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmvdCBIfh48Eeknk9EcyhY/EUByia8dNJsdA49UBgYl79YeoAE1ZBCnXslVyMxP+0apbX7EEDT0C15puJDnVXndeeRGIR/eT6s8JeH6vqhOdqMbAiRlzvoMhvGWyeiHSA==',key_name='tempest-keypair-539876909',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-s5b510vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=68c68428-4d79-4dd7-94a1-9c05e5230a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG os_vif [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1e8656f-16a2-578d-bfd2-34de9ddc4abe', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d0308df-4e, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d0308df-4e, col_values=(('qos', UUID('f040c914-d94d-4d22-b788-288442741ea9')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d0308df-4e, col_values=(('external_ids', {'iface-id': '5d0308df-4ec4-495c-b85e-73900b018564', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:a7:a6', 'vm-uuid': '68c68428-4d79-4dd7-94a1-9c05e5230a8a'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:49 user nova-compute[75469]: INFO os_vif [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e')
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.113s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:49 user nova-compute[75469]: INFO nova.compute.manager [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Migrating
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.194s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:49 user nova-compute[75469]: INFO nova.compute.rpcapi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquired lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Applying migration context for instance fb551839-7b5a-4ecd-b9c0-ab53addeaa45 as it has an incoming, in-progress migration e209f1ff-4fff-46a3-8c86-bd11e783e5d2. Migration status is pre-migrating {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 04:55:49 user nova-compute[75469]: INFO nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating resource usage from migration e209f1ff-4fff-46a3-8c86-bd11e783e5d2
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 0faef65d-62e0-4d48-92d5-f50395b7d190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance ccd1b71a-7ecb-4060-bb65-e635222bfcd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 73091efc-4129-40a8-8d82-c852ac6fa0c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (96d8ab03-209c-478b-97a4-3b20ae4d0ee4): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Migration e209f1ff-4fff-46a3-8c86-bd11e783e5d2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fb551839-7b5a-4ecd-b9c0-ab53addeaa45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:55:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating instance_info_cache with network_info: [{"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Releasing lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:55:50 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Creating image(s)
Nov 14 04:55:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "/opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "/opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'trusted_certs' on Instance uuid fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4e34aecf-8839-4041-aac1-60828847e930 req-3d9e5369-d0fc-4260-8438-b2d86de042f1 service nova] Acquired lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG nova.network.neutron [req-4e34aecf-8839-4041-aac1-60828847e930 req-3d9e5369-d0fc-4260-8438-b2d86de042f1 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Refreshing network info cache for port d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG nova.objects.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Object Instance<fbbae8e3-5d56-41ed-9be2-8856c3420f44> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "6352eaef7369fb8fd7d32537fe3108c9ac92b1a3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "6352eaef7369fb8fd7d32537fe3108c9ac92b1a3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating instance_info_cache with network_info: [{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Releasing lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3.part --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG nova.virt.images [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] 69b045f1-b132-426c-86e4-61ee055c69e2 was qcow2, converting to raw {{(pid=75469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3.part /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3.converted {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Starting migrate_disk_and_power_off {{(pid=75469) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG nova.network.neutron [req-4e34aecf-8839-4041-aac1-60828847e930 req-3d9e5369-d0fc-4260-8438-b2d86de042f1 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updated VIF entry in instance network info cache for port d5b49c15-8461-4b3c-aa57-0dcdd7b12305. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG nova.network.neutron [req-4e34aecf-8839-4041-aac1-60828847e930 req-3d9e5369-d0fc-4260-8438-b2d86de042f1 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating instance_info_cache with network_info: [{"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-c58b1d72-f188-4a4e-8b1c-3686134de11b req-baa04f26-56ce-4210-b1cd-6ca196d58fb1 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c58b1d72-f188-4a4e-8b1c-3686134de11b req-baa04f26-56ce-4210-b1cd-6ca196d58fb1 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c58b1d72-f188-4a4e-8b1c-3686134de11b req-baa04f26-56ce-4210-b1cd-6ca196d58fb1 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c58b1d72-f188-4a4e-8b1c-3686134de11b req-baa04f26-56ce-4210-b1cd-6ca196d58fb1 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-c58b1d72-f188-4a4e-8b1c-3686134de11b req-baa04f26-56ce-4210-b1cd-6ca196d58fb1 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:51 user nova-compute[75469]: WARNING nova.compute.manager [req-c58b1d72-f188-4a4e-8b1c-3686134de11b req-baa04f26-56ce-4210-b1cd-6ca196d58fb1 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state stopped and task_state powering-on.
Nov 14 04:55:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4e34aecf-8839-4041-aac1-60828847e930 req-3d9e5369-d0fc-4260-8438-b2d86de042f1 service nova] Releasing lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3.part /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3.converted" returned: 0 in 0.271s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3.converted --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "6352eaef7369fb8fd7d32537fe3108c9ac92b1a3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.825s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3 --force-share --output=json" returned: 0 in 0.204s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "6352eaef7369fb8fd7d32537fe3108c9ac92b1a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "6352eaef7369fb8fd7d32537fe3108c9ac92b1a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:52 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance destroyed successfully.
Nov 14 04:55:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-501716171',display_name='tempest-ServerActionsTestOtherB-server-501716171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-501716171',id=4,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCM9hFVe3wxoADlpmZS5pvsZqPL5+bIs5VB/4pYIHPJU3LZ6fFGC+bLXtjhSZVFtu7N4xdCrGz0UJgg9Kot0QzE0EwlPJEFb1NBTvEvGy/Q0Twm7zNyBzgTNIwdP75tUg==',key_name='tempest-keypair-1630737506',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a921fed4277644dd9b75295d99c4af6b',ramdisk_id='',reservation_id='r-4b5895c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1992991016',owner_user_name='tempest-ServerActionsTestOtherB-1992991016-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:55:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c089065dec4fbdaf39807c43265ecf',uuid=fb551839-7b5a-4ecd-b9c0-ab53addeaa45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413052241-network", "vif_mac": "fa:16:3e:44:d1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converting VIF {"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413052241-network", "vif_mac": "fa:16:3e:44:d1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_vif [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45923d58-41, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8423f2b-3aa4-4df6-b4a3-4f6e08a5e2d8) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:52 user nova-compute[75469]: INFO os_vif [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41')
Nov 14 04:55:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knptGdZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:55:52 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3 --force-share --output=json" returned: 0 in 0.232s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3,backing_fmt=raw /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafc96d7-4140-4e06-86d8-98b3a16b4916]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:55:52 user nova-compute[75469]: No targets found.
Nov 14 04:55:52 user nova-compute[75469]: iSNS:
Nov 14 04:55:52 user nova-compute[75469]: No targets found.
Nov 14 04:55:52 user nova-compute[75469]: STATIC:
Nov 14 04:55:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188
Nov 14 04:55:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:55:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:55:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 04:55:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:52 user nova-compute[75469]: FIRMWARE:
Nov 14 04:55:52 user nova-compute[75469]: No targets found.
Nov 14 04:55:52 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:55:52 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:55:52 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3,backing_fmt=raw /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk 1073741824" returned: 0 in 0.058s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "6352eaef7369fb8fd7d32537fe3108c9ac92b1a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff967057-75ee-4643-a98c-ee3f3c1e42e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93d9133-4865-449b-bbe5-827f0bd209ca]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:52 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:52 user nova-compute[75469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:55:52 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:52 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:52 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:52 user nova-compute[75469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:55:52 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:52 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f67760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342d402-6685-4715-96c5-3f9a890c10e1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5724d04a-cf4f-49fb-97a9-9e31043ba10e]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb93acfb-f79e-44da-a6ba-c8f4869135b9]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3 --force-share --output=json" returned: 0 in 0.198s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'migration_context' on Instance uuid fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a29eb22-6693-41c0-b6a0-7c07510d98d8]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG nova.objects.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Object Instance<fbbae8e3-5d56-41ed-9be2-8856c3420f44> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:55:52 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Rebasing disk image.
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[302552eb-7c4e-48f8-afb4-66c89c96f6bb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b19ad6-a212-4728-980b-5f661b0f4cea]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]
Nov 14 04:55:52 user nova-compute[75469]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.
Nov 14 04:55:52 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[784a4eda-ea62-4e61-850a-e0ce8e9944bf]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] <== disconnect_volume: return (436ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.194s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 -F raw /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45_resize/disk /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:55:53 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance rebooted successfully.
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-b7d72dc3-79dc-43e5-bfc7-aa377b0466c2 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "cp -r /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45_resize/disk /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk" returned: 0 in 0.465s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45_resize/disk.info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk.info {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "cp -r /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45_resize/disk.info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk.info" returned: 0 in 0.042s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:53 user nova-compute[75469]: WARNING nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state active and task_state None.
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:53 user nova-compute[75469]: WARNING nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state active and task_state resize_migrating.
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:53 user nova-compute[75469]: WARNING nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state active and task_state resize_migrating.
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:53 user nova-compute[75469]: WARNING nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state active and task_state resize_migrating.
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:53 user nova-compute[75469]: WARNING nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state active and task_state resize_migrating.
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:53 user nova-compute[75469]: WARNING nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state active and task_state resize_migrating.
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:53 user nova-compute[75469]: WARNING nova.compute.manager [req-7e7615dd-f658-4bec-9c8e-3957ea348d75 req-9d618211-5124-497e-bc8f-516f73290c1b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state active and task_state resize_migrating.
Nov 14 04:55:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Port 45923d58-4176-482f-b9c0-6f871c90529c binding to destination host user is already ACTIVE {{(pid=75469) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 -F raw /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk" returned: 0 in 2.162s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Ensure instance console log exists: /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Start _get_guest_xml network_info=[{"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='ffff0aa8160f71e3f1d915d784ff4d4c',container_format='bare',created_at=2023-11-14T04:53:50Z,direct_url=<?>,disk_format='qcow2',id=69b045f1-b132-426c-86e4-61ee055c69e2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-864532062-shelved',owner='95fb1cdf42b04f37b025ed7385c4af37',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T04:53:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '03a00b9c-882d-4fcf-94d7-aa4ac7af96ac', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRPvHJdW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'fbbae8e3-5d56-41ed-9be2-8856c3420f44', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1', 'serial': 'd4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:55:55 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:55:55 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ffff0aa8160f71e3f1d915d784ff4d4c',container_format='bare',created_at=2023-11-14T04:53:50Z,direct_url=<?>,disk_format='qcow2',id=69b045f1-b132-426c-86e4-61ee055c69e2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-864532062-shelved',owner='95fb1cdf42b04f37b025ed7385c4af37',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T04:53:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'vcpu_model' on Instance uuid fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.objects.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Object Instance<fbbae8e3-5d56-41ed-9be2-8856c3420f44> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRPvHJdW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:55:55 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:55:55 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:55:55 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc5efd5-1ba5-4712-9360-7dba8d192506]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:55:55 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e161e5-502e-49b8-ab50-5bc50bc2c1a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1] added
Nov 14 04:55:55 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[49265f1c-815a-4dc3-aabe-a8a4463cccd1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cc7ff8-b7f0-4b2f-af68-23d799d649ca]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRPvHJdW {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRPvHJdW" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5fbb6b-67b7-4ab5-ba90-9d131255f973]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zRPvHJdW'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b652b3-2dcf-4a4f-b11c-56b5f8680094]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[305ada2f-8d29-40b9-898e-266c975ee1b7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:55 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:55 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:55 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:55 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:55 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:55 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquired lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aafa7a-88ce-4f86-81b1-e0e74e6718c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1, portal: 172.16.0.220,3260]
Nov 14 04:55:55 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1, portal: 172.16.0.220,3260] successful.
Nov 14 04:55:55 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba90703-7f45-4bd8-8f57-486e81a665f1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcfe36d-b29f-4163-84ac-99152151e308]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:55 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:55 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:55 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:55:55 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:55 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:55 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:55 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:55:55 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe511414-beca-4a65-b649-d8b30dea8b70]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRPvHJdW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:55:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating instance_info_cache with network_info: [{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Releasing lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG os_brick.utils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bf6655-4dc8-4af3-a572-fa7d7b42ab18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e392dc-e50b-4d91-b5a4-9ea46cd17f2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6eab7d-9338-4a30-887b-aa08984b6b9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2d98c2-1815-49f3-b781-310554be0c8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:55:56 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:55:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f042e0-4e86-4fcb-8500-63aaf1a58623]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG os_brick.utils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23038643133323735', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038643133323735', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T04:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-864532062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-864532062',id=5,image_ref='69b045f1-b132-426c-86e4-61ee055c69e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1957997782',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-458dg48g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member',shelved_at='2023-11-14T04:53:54.474511',shelved_host='user',shelved_image_id='69b045f1-b132-426c-86e4-61ee055c69e2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=fbbae8e3-5d56-41ed-9be2-8856c3420f44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'pci_devices' on Instance uuid fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.objects.base [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Object Instance<fbbae8e3-5d56-41ed-9be2-8856c3420f44> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:55:56 user nova-compute[75469]:   <uuid>fbbae8e3-5d56-41ed-9be2-8856c3420f44</uuid>
Nov 14 04:55:56 user nova-compute[75469]:   <name>instance-00000005</name>
Nov 14 04:55:56 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:55:56 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:55:56 user nova-compute[75469]:   <metadata>
Nov 14 04:55:56 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:55:56 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:55:56 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-864532062</nova:name>
Nov 14 04:55:56 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:55:55</nova:creationTime>
Nov 14 04:55:56 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:55:56 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:55:56 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:55:56 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:55:56 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:55:56 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:55:56 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:55:56 user nova-compute[75469]:       <nova:owner>
Nov 14 04:55:56 user nova-compute[75469]:         <nova:user uuid="88fb3641cda04c96b925d7b83af359b6">tempest-AttachVolumeShelveTestJSON-41564664-project-member</nova:user>
Nov 14 04:55:56 user nova-compute[75469]:         <nova:project uuid="95fb1cdf42b04f37b025ed7385c4af37">tempest-AttachVolumeShelveTestJSON-41564664</nova:project>
Nov 14 04:55:56 user nova-compute[75469]:       </nova:owner>
Nov 14 04:55:56 user nova-compute[75469]:       <nova:root type="image" uuid="69b045f1-b132-426c-86e4-61ee055c69e2"/>
Nov 14 04:55:56 user nova-compute[75469]:       <nova:ports>
Nov 14 04:55:56 user nova-compute[75469]:         <nova:port uuid="d5b49c15-8461-4b3c-aa57-0dcdd7b12305">
Nov 14 04:55:56 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 04:55:56 user nova-compute[75469]:         </nova:port>
Nov 14 04:55:56 user nova-compute[75469]:       </nova:ports>
Nov 14 04:55:56 user nova-compute[75469]:     </nova:instance>
Nov 14 04:55:56 user nova-compute[75469]:   </metadata>
Nov 14 04:55:56 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:55:56 user nova-compute[75469]:     <system>
Nov 14 04:55:56 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:55:56 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:55:56 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:55:56 user nova-compute[75469]:       <entry name="serial">fbbae8e3-5d56-41ed-9be2-8856c3420f44</entry>
Nov 14 04:55:56 user nova-compute[75469]:       <entry name="uuid">fbbae8e3-5d56-41ed-9be2-8856c3420f44</entry>
Nov 14 04:55:56 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:55:56 user nova-compute[75469]:     </system>
Nov 14 04:55:56 user nova-compute[75469]:   </sysinfo>
Nov 14 04:55:56 user nova-compute[75469]:   <os>
Nov 14 04:55:56 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:55:56 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:55:56 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:55:56 user nova-compute[75469]:   </os>
Nov 14 04:55:56 user nova-compute[75469]:   <features>
Nov 14 04:55:56 user nova-compute[75469]:     <acpi/>
Nov 14 04:55:56 user nova-compute[75469]:     <apic/>
Nov 14 04:55:56 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:55:56 user nova-compute[75469]:   </features>
Nov 14 04:55:56 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:55:56 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:55:56 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:55:56 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:55:56 user nova-compute[75469]:   </clock>
Nov 14 04:55:56 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:55:56 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:55:56 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:55:56 user nova-compute[75469]:   </cpu>
Nov 14 04:55:56 user nova-compute[75469]:   <devices>
Nov 14 04:55:56 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:55:56 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:55:56 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk"/>
Nov 14 04:55:56 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:55:56 user nova-compute[75469]:     </disk>
Nov 14 04:55:56 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:55:56 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:55:56 user nova-compute[75469]:       <source dev="/dev/sdb"/>
Nov 14 04:55:56 user nova-compute[75469]:       <target dev="vdc" bus="virtio"/>
Nov 14 04:55:56 user nova-compute[75469]:       <serial>d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1</serial>
Nov 14 04:55:56 user nova-compute[75469]:     </disk>
Nov 14 04:55:56 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:55:56 user nova-compute[75469]:       <mac address="fa:16:3e:a9:9c:ef"/>
Nov 14 04:55:56 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:55:56 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:55:56 user nova-compute[75469]:       <target dev="tapd5b49c15-84"/>
Nov 14 04:55:56 user nova-compute[75469]:     </interface>
Nov 14 04:55:56 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:55:56 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/console.log" append="off"/>
Nov 14 04:55:56 user nova-compute[75469]:     </serial>
Nov 14 04:55:56 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:55:56 user nova-compute[75469]:     <video>
Nov 14 04:55:56 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:55:56 user nova-compute[75469]:     </video>
Nov 14 04:55:56 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:55:56 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:55:56 user nova-compute[75469]:     </rng>
Nov 14 04:55:56 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:55:56 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:55:56 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:55:56 user nova-compute[75469]:     </memballoon>
Nov 14 04:55:56 user nova-compute[75469]:   </devices>
Nov 14 04:55:56 user nova-compute[75469]: </domain>
Nov 14 04:55:56 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T04:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-864532062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-864532062',id=5,image_ref='69b045f1-b132-426c-86e4-61ee055c69e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1957997782',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-458dg48g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member',shelved_at='2023-11-14T04:53:54.474511',shelved_host='user',shelved_image_id='69b045f1-b132-426c-86e4-61ee055c69e2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=fbbae8e3-5d56-41ed-9be2-8856c3420f44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG os_vif [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dbb41d3-d57d-5f07-a62f-f6e2581d55c7', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5b49c15-84, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5b49c15-84, col_values=(('qos', UUID('bdb30aca-118d-40a8-82dd-8ed77347a276')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5b49c15-84, col_values=(('external_ids', {'iface-id': 'd5b49c15-8461-4b3c-aa57-0dcdd7b12305', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:9c:ef', 'vm-uuid': 'fbbae8e3-5d56-41ed-9be2-8856c3420f44'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:56 user nova-compute[75469]: INFO os_vif [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84')
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:55:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] No VIF found with MAC fa:16:3e:a9:9c:ef, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:55:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.006s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:58 user nova-compute[75469]: INFO nova.compute.manager [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Terminating instance
Nov 14 04:55:58 user nova-compute[75469]: DEBUG nova.compute.manager [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:55:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-c3703a96-54f5-45c9-b7c3-f23da4b8cc6d req-1a7d6153-1180-4985-8d59-d24c4300712b service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-vif-unplugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c3703a96-54f5-45c9-b7c3-f23da4b8cc6d req-1a7d6153-1180-4985-8d59-d24c4300712b service nova] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c3703a96-54f5-45c9-b7c3-f23da4b8cc6d req-1a7d6153-1180-4985-8d59-d24c4300712b service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c3703a96-54f5-45c9-b7c3-f23da4b8cc6d req-1a7d6153-1180-4985-8d59-d24c4300712b service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-c3703a96-54f5-45c9-b7c3-f23da4b8cc6d req-1a7d6153-1180-4985-8d59-d24c4300712b service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] No waiting events found dispatching network-vif-unplugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-c3703a96-54f5-45c9-b7c3-f23da4b8cc6d req-1a7d6153-1180-4985-8d59-d24c4300712b service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-vif-unplugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Instance destroyed successfully.
Nov 14 04:55:59 user nova-compute[75469]: DEBUG nova.objects.instance [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lazy-loading 'resources' on Instance uuid ccd1b71a-7ecb-4060-bb65-e635222bfcd7 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T04:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-331822876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1029265996',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC0zGU7wJbLcSAC/xTktGHci7HFpvF3FBGGyk0HjgBCCZNw0EArtz9rjG5wJKkYHxC+4AB+HvLzS6vHSWBtNzcZW1BauRPxYSQ65AoHAJP9lrBL9q0UtI4jY1kwja3I9w==',key_name='tempest-keypair-896811283',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:54:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb898273020b4563966aedc3204042c8',ramdisk_id='',reservation_id='r-omkk1ohs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-196671126',owner_user_name='tempest-ServerActionsV293TestJSON-196671126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='149fe6f4b2584ddb98cce41ca1f943fc',uuid=ccd1b71a-7ecb-4060-bb65-e635222bfcd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converting VIF {"id": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "address": "fa:16:3e:9f:e4:9c", "network": {"id": "d487be5e-dbff-4946-8cc8-f6e4706333dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-600350593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb898273020b4563966aedc3204042c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e4eb96-0f", "ovs_interfaceid": "f7e4eb96-0f42-46e0-a34c-54749e5d33b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_vif [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7e4eb96-0f, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=913b713f-45f7-4768-97bc-fd20a4b4522c) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:55:59 user nova-compute[75469]: INFO os_vif [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e4:9c,bridge_name='br-int',has_traffic_filtering=True,id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9,network=Network(d487be5e-dbff-4946-8cc8-f6e4706333dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e4eb96-0f')
Nov 14 04:55:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtGiQqMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:55:59 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c40231-2493-4e67-8f20-5578449b123d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:55:59 user nova-compute[75469]: No targets found.
Nov 14 04:55:59 user nova-compute[75469]: iSNS:
Nov 14 04:55:59 user nova-compute[75469]: No targets found.
Nov 14 04:55:59 user nova-compute[75469]: STATIC:
Nov 14 04:55:59 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d
Nov 14 04:55:59 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:59 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:59 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:55:59 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:59 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:59 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 04:55:59 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:59 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:59 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1
Nov 14 04:55:59 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:55:59 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:55:59 user nova-compute[75469]: FIRMWARE:
Nov 14 04:55:59 user nova-compute[75469]: No targets found.
Nov 14 04:55:59 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:55:59 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:55:59 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f0a437-341a-4fd3-aa6a-96a9ff55ccbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf5df79-c55b-4fc6-9e3f-88e13196191b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:59 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:59 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:59 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:55:59 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d (non-flash)
Nov 14 04:55:59 user nova-compute[75469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:55:59 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:55:59 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:55:59 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708fab910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d'): ({'sdg'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Removing single pathed devices sdg {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bbacc5-b66c-4b01-aa86-e72e5623d425]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be387bd-031a-4e51-a21a-92c547f032e8]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Flushing IO for device /dev/sdg {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b6e718-7a0d-48c2-a681-e3c4a9a2f4d0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc1c63f-3ac1-4b74-84cf-a749b222eab6]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] SCSI volumes sdg have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e3040e-0def-4e24-b9d0-449f4a35b28c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0bbeeb-6cde-4625-93d1-92856090207d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260]
Nov 14 04:55:59 user nova-compute[75469]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d, portal: 172.16.0.220,3260] successful.
Nov 14 04:55:59 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6d71d08-ba53-43c2-955e-526da6f4836d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ff3056-b2f6-4cea-a2f2-434a2911e0eb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] <== disconnect_volume: return (394ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:55:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:55:59 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Deleting instance files /opt/stack/data/nova/instances/ccd1b71a-7ecb-4060-bb65-e635222bfcd7_del
Nov 14 04:55:59 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Deletion of /opt/stack/data/nova/instances/ccd1b71a-7ecb-4060-bb65-e635222bfcd7_del complete
Nov 14 04:56:00 user nova-compute[75469]: INFO nova.compute.manager [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 14 04:56:00 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:56:00 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:56:00 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:56:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:56:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:56:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:56:00 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Instance spawned successfully.
Nov 14 04:56:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:56:00 user nova-compute[75469]: INFO nova.compute.claims [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Claim successful on node user
Nov 14 04:56:00 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:56:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:00 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Took 0.92 seconds to deallocate network for instance.
Nov 14 04:56:00 user nova-compute[75469]: DEBUG nova.compute.manager [req-52b17e3b-8b83-48bc-bc75-8bcb0ff6ac9a req-4552fa1e-590c-4114-b8e2-de7ace867b79 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-vif-deleted-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:00 user nova-compute[75469]: INFO nova.compute.manager [req-52b17e3b-8b83-48bc-bc75-8bcb0ff6ac9a req-4552fa1e-590c-4114-b8e2-de7ace867b79 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Neutron deleted interface f7e4eb96-0f42-46e0-a34c-54749e5d33b9; detaching it from the instance and deleting it from the info cache
Nov 14 04:56:00 user nova-compute[75469]: DEBUG nova.network.neutron [req-52b17e3b-8b83-48bc-bc75-8bcb0ff6ac9a req-4552fa1e-590c-4114-b8e2-de7ace867b79 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-52b17e3b-8b83-48bc-bc75-8bcb0ff6ac9a req-4552fa1e-590c-4114-b8e2-de7ace867b79 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Detach interface failed, port_id=f7e4eb96-0f42-46e0-a34c-54749e5d33b9, reason: Instance ccd1b71a-7ecb-4060-bb65-e635222bfcd7 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-faf2ba2f-fc6c-4615-a25f-6e5832df71f0 req-54ec17f2-75a6-4f5a-b350-e224358cea50 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-faf2ba2f-fc6c-4615-a25f-6e5832df71f0 req-54ec17f2-75a6-4f5a-b350-e224358cea50 service nova] Acquiring lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-faf2ba2f-fc6c-4615-a25f-6e5832df71f0 req-54ec17f2-75a6-4f5a-b350-e224358cea50 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-faf2ba2f-fc6c-4615-a25f-6e5832df71f0 req-54ec17f2-75a6-4f5a-b350-e224358cea50 service nova] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-faf2ba2f-fc6c-4615-a25f-6e5832df71f0 req-54ec17f2-75a6-4f5a-b350-e224358cea50 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] No waiting events found dispatching network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:01 user nova-compute[75469]: WARNING nova.compute.manager [req-faf2ba2f-fc6c-4615-a25f-6e5832df71f0 req-54ec17f2-75a6-4f5a-b350-e224358cea50 service nova] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Received unexpected event network-vif-plugged-f7e4eb96-0f42-46e0-a34c-54749e5d33b9 for instance with vm_state active and task_state deleting.
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3c481d90-c4b8-44ff-b2d9-52c3e3da86c4 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.823s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.726s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.network.neutron [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:56:01 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.policy [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e98acc8e0c8044cca5d6f7a35b3bdad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59f6cc7c2254d4ba2581a445e02075f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Starting finish_migration {{(pid=75469) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance directory exists: not creating {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 04:56:01 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Creating image(s)
Nov 14 04:56:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:01 user nova-compute[75469]: INFO nova.compute.manager [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Took 0.90 seconds to detach 1 volumes for instance.
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:56:01 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Creating image(s)
Nov 14 04:56:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "/opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "/opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "/opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.039s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] [instance: ccd1b71a-7ecb-4060-bb65-e635222bfcd7] Deleting volume: b6d71d08-ba53-43c2-955e-526da6f4836d {{(pid=75469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 04:56:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.207s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk. size=21474836480 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.218s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk 21474836480 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk 21474836480" returned: 0 in 0.075s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Ensure instance console log exists: /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Start _get_guest_xml network_info=[{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413052241-network", "vif_mac": "fa:16:3e:44:d1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '9de2e161-9167-47b8-abdc-283ab64c257f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knptGdZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'fb551839-7b5a-4ecd-b9c0-ab53addeaa45', 'attached_at': '2023-11-14T04:56:02.000000', 'detached_at': '', 'volume_id': '3fc11541-4c2d-4184-bee8-29391718e188', 'serial': '3fc11541-4c2d-4184-bee8-29391718e188'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.248s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk 1073741824" returned: 0 in 0.069s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:02 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knptGdZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:56:02 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:56:02 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:56:02 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aff8bf-6c2e-4801-9642-a04e417c57ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:56:02 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d41908-d8e5-4331-8807-1a7d932d2f09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188] added
Nov 14 04:56:02 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.224s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0ee82d-6e75-454b-8f65-0be5a15f7568]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.network.neutron [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Successfully created port: ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[177b3e4c-70cf-4e45-aa74-ad61df80112f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knptGdZo {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knptGdZo" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[df72aeb3-33b6-45f9-909f-e5adf9785afa]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'knptGdZo'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e877c7c7-0291-4c68-950f-8fbdd72f5938]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.671s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6036e9-9782-4b8c-bb81-c9c8e1be47f4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:56:02 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:56:02 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:56:02 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:56:02 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:56:02 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:56:02 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Deleted allocations for instance ccd1b71a-7ecb-4060-bb65-e635222bfcd7
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c1f737-4917-47db-a2ee-12bdd3053b57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]
Nov 14 04:56:02 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.
Nov 14 04:56:02 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Cannot resize image /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Ensure instance console log exists: /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[81463c46-41ef-4654-b958-4f7b5d74f7b2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61e8b5ee-6636-4f95-820d-c346d72a8c47 tempest-ServerActionsV293TestJSON-196671126 tempest-ServerActionsV293TestJSON-196671126-project-member] Lock "ccd1b71a-7ecb-4060-bb65-e635222bfcd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.317s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ea5de2-de75-4c07-a41e-bd102f584e45]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:56:03 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:56:03 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:56:03 user nova-compute[75469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:56:03 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:56:03 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:56:03 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:56:03 user nova-compute[75469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:56:03 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.480s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a482f4b-8eab-49e3-aa20-530e32d42e87]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-d9972ebc-499f-405e-b0c4-d8fcbfe7e271 req-1278b118-d833-4f07-b3d7-215f2d873ea2 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d9972ebc-499f-405e-b0c4-d8fcbfe7e271 req-1278b118-d833-4f07-b3d7-215f2d873ea2 service nova] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d9972ebc-499f-405e-b0c4-d8fcbfe7e271 req-1278b118-d833-4f07-b3d7-215f2d873ea2 service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d9972ebc-499f-405e-b0c4-d8fcbfe7e271 req-1278b118-d833-4f07-b3d7-215f2d873ea2 service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-d9972ebc-499f-405e-b0c4-d8fcbfe7e271 req-1278b118-d833-4f07-b3d7-215f2d873ea2 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] No waiting events found dispatching network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:03 user nova-compute[75469]: WARNING nova.compute.manager [req-d9972ebc-499f-405e-b0c4-d8fcbfe7e271 req-1278b118-d833-4f07-b3d7-215f2d873ea2 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received unexpected event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 for instance with vm_state active and task_state None.
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.network.neutron [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Successfully updated port: ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "refresh_cache-61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquired lock "refresh_cache-61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.network.neutron [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-aadb9bfa-4d39-41ca-9571-67e4f38c673f req-3eeb546b-19ec-44b7-866f-066030d9484f service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-changed-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-aadb9bfa-4d39-41ca-9571-67e4f38c673f req-3eeb546b-19ec-44b7-866f-066030d9484f service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Refreshing instance network info cache due to event network-changed-ae16d917-f1e7-40f3-86cf-ea7150673ddb. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aadb9bfa-4d39-41ca-9571-67e4f38c673f req-3eeb546b-19ec-44b7-866f-066030d9484f service nova] Acquiring lock "refresh_cache-61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.network.neutron [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.network.neutron [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Updating instance_info_cache with network_info: [{"id": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "address": "fa:16:3e:a3:b1:4e", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae16d917-f1", "ovs_interfaceid": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Releasing lock "refresh_cache-61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.compute.manager [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Instance network_info: |[{"id": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "address": "fa:16:3e:a3:b1:4e", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae16d917-f1", "ovs_interfaceid": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aadb9bfa-4d39-41ca-9571-67e4f38c673f req-3eeb546b-19ec-44b7-866f-066030d9484f service nova] Acquired lock "refresh_cache-61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.network.neutron [req-aadb9bfa-4d39-41ca-9571-67e4f38c673f req-3eeb546b-19ec-44b7-866f-066030d9484f service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Refreshing network info cache for port ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Start _get_guest_xml network_info=[{"id": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "address": "fa:16:3e:a3:b1:4e", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae16d917-f1", "ovs_interfaceid": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:56:03 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:03 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:56:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1528269765',display_name='tempest-AttachVolumeNegativeTest-server-1528269765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1528269765',id=15,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdR92RcMJBA2oeZ6PYlLVhSjmZffwdo6450kuRiXxwF4WzTEZmz7GocX+iya5ea5d/2S4Pcoa/7WzGKAjT7mVX0mH/kaTOtYNouOHT4/upg9UZ3Am7CyS/Yv8Wzqk9++Q==',key_name='tempest-keypair-127081686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-wnw0kfjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:56:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=61e6e3ab-dd35-4b49-8f9f-c89cd5db0840,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "address": "fa:16:3e:a3:b1:4e", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae16d917-f1", "ovs_interfaceid": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "address": "fa:16:3e:a3:b1:4e", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae16d917-f1", "ovs_interfaceid": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b1:4e,bridge_name='br-int',has_traffic_filtering=True,id=ae16d917-f1e7-40f3-86cf-ea7150673ddb,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae16d917-f1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'pci_devices' on Instance uuid 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:56:04 user nova-compute[75469]:   <uuid>61e6e3ab-dd35-4b49-8f9f-c89cd5db0840</uuid>
Nov 14 04:56:04 user nova-compute[75469]:   <name>instance-0000000f</name>
Nov 14 04:56:04 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:56:04 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:56:04 user nova-compute[75469]:   <metadata>
Nov 14 04:56:04 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:56:04 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1528269765</nova:name>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:56:03</nova:creationTime>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:56:04 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:56:04 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:owner>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:user uuid="e98acc8e0c8044cca5d6f7a35b3bdad0">tempest-AttachVolumeNegativeTest-1768463318-project-member</nova:user>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:project uuid="c59f6cc7c2254d4ba2581a445e02075f">tempest-AttachVolumeNegativeTest-1768463318</nova:project>
Nov 14 04:56:04 user nova-compute[75469]:       </nova:owner>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:ports>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:port uuid="ae16d917-f1e7-40f3-86cf-ea7150673ddb">
Nov 14 04:56:04 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 04:56:04 user nova-compute[75469]:         </nova:port>
Nov 14 04:56:04 user nova-compute[75469]:       </nova:ports>
Nov 14 04:56:04 user nova-compute[75469]:     </nova:instance>
Nov 14 04:56:04 user nova-compute[75469]:   </metadata>
Nov 14 04:56:04 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:56:04 user nova-compute[75469]:     <system>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="serial">61e6e3ab-dd35-4b49-8f9f-c89cd5db0840</entry>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="uuid">61e6e3ab-dd35-4b49-8f9f-c89cd5db0840</entry>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:56:04 user nova-compute[75469]:     </system>
Nov 14 04:56:04 user nova-compute[75469]:   </sysinfo>
Nov 14 04:56:04 user nova-compute[75469]:   <os>
Nov 14 04:56:04 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:56:04 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:56:04 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:56:04 user nova-compute[75469]:   </os>
Nov 14 04:56:04 user nova-compute[75469]:   <features>
Nov 14 04:56:04 user nova-compute[75469]:     <acpi/>
Nov 14 04:56:04 user nova-compute[75469]:     <apic/>
Nov 14 04:56:04 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:56:04 user nova-compute[75469]:   </features>
Nov 14 04:56:04 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:56:04 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:56:04 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:56:04 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:56:04 user nova-compute[75469]:   </clock>
Nov 14 04:56:04 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:56:04 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:56:04 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:56:04 user nova-compute[75469]:   </cpu>
Nov 14 04:56:04 user nova-compute[75469]:   <devices>
Nov 14 04:56:04 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:56:04 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:56:04 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk"/>
Nov 14 04:56:04 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:56:04 user nova-compute[75469]:     </disk>
Nov 14 04:56:04 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:56:04 user nova-compute[75469]:       <mac address="fa:16:3e:a3:b1:4e"/>
Nov 14 04:56:04 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:56:04 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:56:04 user nova-compute[75469]:       <target dev="tapae16d917-f1"/>
Nov 14 04:56:04 user nova-compute[75469]:     </interface>
Nov 14 04:56:04 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:56:04 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/console.log" append="off"/>
Nov 14 04:56:04 user nova-compute[75469]:     </serial>
Nov 14 04:56:04 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:56:04 user nova-compute[75469]:     <video>
Nov 14 04:56:04 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:56:04 user nova-compute[75469]:     </video>
Nov 14 04:56:04 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:56:04 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:56:04 user nova-compute[75469]:     </rng>
Nov 14 04:56:04 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:56:04 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:56:04 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:56:04 user nova-compute[75469]:     </memballoon>
Nov 14 04:56:04 user nova-compute[75469]:   </devices>
Nov 14 04:56:04 user nova-compute[75469]: </domain>
Nov 14 04:56:04 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1528269765',display_name='tempest-AttachVolumeNegativeTest-server-1528269765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1528269765',id=15,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdR92RcMJBA2oeZ6PYlLVhSjmZffwdo6450kuRiXxwF4WzTEZmz7GocX+iya5ea5d/2S4Pcoa/7WzGKAjT7mVX0mH/kaTOtYNouOHT4/upg9UZ3Am7CyS/Yv8Wzqk9++Q==',key_name='tempest-keypair-127081686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-wnw0kfjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:56:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=61e6e3ab-dd35-4b49-8f9f-c89cd5db0840,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "address": "fa:16:3e:a3:b1:4e", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae16d917-f1", "ovs_interfaceid": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "address": "fa:16:3e:a3:b1:4e", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae16d917-f1", "ovs_interfaceid": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b1:4e,bridge_name='br-int',has_traffic_filtering=True,id=ae16d917-f1e7-40f3-86cf-ea7150673ddb,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae16d917-f1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG os_vif [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b1:4e,bridge_name='br-int',has_traffic_filtering=True,id=ae16d917-f1e7-40f3-86cf-ea7150673ddb,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae16d917-f1') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b18570d-7129-5927-91b7-5a283aae0201', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae16d917-f1, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae16d917-f1, col_values=(('qos', UUID('f7273587-8cd4-4225-aba4-dcd6c67293fd')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae16d917-f1, col_values=(('external_ids', {'iface-id': 'ae16d917-f1e7-40f3-86cf-ea7150673ddb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:b1:4e', 'vm-uuid': '61e6e3ab-dd35-4b49-8f9f-c89cd5db0840'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: INFO os_vif [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b1:4e,bridge_name='br-int',has_traffic_filtering=True,id=ae16d917-f1e7-40f3-86cf-ea7150673ddb,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae16d917-f1')
Nov 14 04:56:04 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knptGdZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.515s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] <== connect_volume: return (1517ms) {'type': 'block', 'scsi_wwn': '23466663565613362', 'path': '/dev/sde'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466663565613362', 'path': '/dev/sde'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-501716171',display_name='tempest-ServerActionsTestOtherB-server-501716171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-501716171',id=4,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCM9hFVe3wxoADlpmZS5pvsZqPL5+bIs5VB/4pYIHPJU3LZ6fFGC+bLXtjhSZVFtu7N4xdCrGz0UJgg9Kot0QzE0EwlPJEFb1NBTvEvGy/Q0Twm7zNyBzgTNIwdP75tUg==',key_name='tempest-keypair-1630737506',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a921fed4277644dd9b75295d99c4af6b',ramdisk_id='',reservation_id='r-4b5895c5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1992991016',owner_user_name='tempest-ServerActionsTestOtherB-1992991016-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:55:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c089065dec4fbdaf39807c43265ecf',uuid=fb551839-7b5a-4ecd-b9c0-ab53addeaa45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413052241-network", "vif_mac": "fa:16:3e:44:d1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converting VIF {"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413052241-network", "vif_mac": "fa:16:3e:44:d1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:56:04 user nova-compute[75469]:   <uuid>fb551839-7b5a-4ecd-b9c0-ab53addeaa45</uuid>
Nov 14 04:56:04 user nova-compute[75469]:   <name>instance-00000004</name>
Nov 14 04:56:04 user nova-compute[75469]:   <memory>2097152</memory>
Nov 14 04:56:04 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:56:04 user nova-compute[75469]:   <metadata>
Nov 14 04:56:04 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:56:04 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:name>tempest-ServerActionsTestOtherB-server-501716171</nova:name>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:56:02</nova:creationTime>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:flavor name="m1.small">
Nov 14 04:56:04 user nova-compute[75469]:         <nova:memory>2048</nova:memory>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:disk>20</nova:disk>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:56:04 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:owner>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:user uuid="73c089065dec4fbdaf39807c43265ecf">tempest-ServerActionsTestOtherB-1992991016-project-member</nova:user>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:project uuid="a921fed4277644dd9b75295d99c4af6b">tempest-ServerActionsTestOtherB-1992991016</nova:project>
Nov 14 04:56:04 user nova-compute[75469]:       </nova:owner>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:56:04 user nova-compute[75469]:       <nova:ports>
Nov 14 04:56:04 user nova-compute[75469]:         <nova:port uuid="45923d58-4176-482f-b9c0-6f871c90529c">
Nov 14 04:56:04 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 04:56:04 user nova-compute[75469]:         </nova:port>
Nov 14 04:56:04 user nova-compute[75469]:       </nova:ports>
Nov 14 04:56:04 user nova-compute[75469]:     </nova:instance>
Nov 14 04:56:04 user nova-compute[75469]:   </metadata>
Nov 14 04:56:04 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:56:04 user nova-compute[75469]:     <system>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="serial">fb551839-7b5a-4ecd-b9c0-ab53addeaa45</entry>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="uuid">fb551839-7b5a-4ecd-b9c0-ab53addeaa45</entry>
Nov 14 04:56:04 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:56:04 user nova-compute[75469]:     </system>
Nov 14 04:56:04 user nova-compute[75469]:   </sysinfo>
Nov 14 04:56:04 user nova-compute[75469]:   <os>
Nov 14 04:56:04 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:56:04 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:56:04 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:56:04 user nova-compute[75469]:   </os>
Nov 14 04:56:04 user nova-compute[75469]:   <features>
Nov 14 04:56:04 user nova-compute[75469]:     <acpi/>
Nov 14 04:56:04 user nova-compute[75469]:     <apic/>
Nov 14 04:56:04 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:56:04 user nova-compute[75469]:   </features>
Nov 14 04:56:04 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:56:04 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:56:04 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:56:04 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:56:04 user nova-compute[75469]:   </clock>
Nov 14 04:56:04 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:56:04 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:56:04 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:56:04 user nova-compute[75469]:   </cpu>
Nov 14 04:56:04 user nova-compute[75469]:   <devices>
Nov 14 04:56:04 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:56:04 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:56:04 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk"/>
Nov 14 04:56:04 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:56:04 user nova-compute[75469]:     </disk>
Nov 14 04:56:04 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:56:04 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:56:04 user nova-compute[75469]:       <source dev="/dev/sde"/>
Nov 14 04:56:04 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 04:56:04 user nova-compute[75469]:       <serial>3fc11541-4c2d-4184-bee8-29391718e188</serial>
Nov 14 04:56:04 user nova-compute[75469]:     </disk>
Nov 14 04:56:04 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:56:04 user nova-compute[75469]:       <mac address="fa:16:3e:44:d1:3e"/>
Nov 14 04:56:04 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:56:04 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:56:04 user nova-compute[75469]:       <target dev="tap45923d58-41"/>
Nov 14 04:56:04 user nova-compute[75469]:     </interface>
Nov 14 04:56:04 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:56:04 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/console.log" append="off"/>
Nov 14 04:56:04 user nova-compute[75469]:     </serial>
Nov 14 04:56:04 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:56:04 user nova-compute[75469]:     <video>
Nov 14 04:56:04 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:56:04 user nova-compute[75469]:     </video>
Nov 14 04:56:04 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:56:04 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:56:04 user nova-compute[75469]:     </rng>
Nov 14 04:56:04 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:56:04 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:56:04 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:56:04 user nova-compute[75469]:     </memballoon>
Nov 14 04:56:04 user nova-compute[75469]:   </devices>
Nov 14 04:56:04 user nova-compute[75469]: </domain>
Nov 14 04:56:04 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-501716171',display_name='tempest-ServerActionsTestOtherB-server-501716171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-501716171',id=4,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCM9hFVe3wxoADlpmZS5pvsZqPL5+bIs5VB/4pYIHPJU3LZ6fFGC+bLXtjhSZVFtu7N4xdCrGz0UJgg9Kot0QzE0EwlPJEFb1NBTvEvGy/Q0Twm7zNyBzgTNIwdP75tUg==',key_name='tempest-keypair-1630737506',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a921fed4277644dd9b75295d99c4af6b',ramdisk_id='',reservation_id='r-4b5895c5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1992991016',owner_user_name='tempest-ServerActionsTestOtherB-1992991016-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:55:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c089065dec4fbdaf39807c43265ecf',uuid=fb551839-7b5a-4ecd-b9c0-ab53addeaa45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413052241-network", "vif_mac": "fa:16:3e:44:d1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converting VIF {"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413052241-network", "vif_mac": "fa:16:3e:44:d1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG os_vif [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ae442ef-a2b1-5c06-9bdc-f76ae96c415f', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45923d58-41, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45923d58-41, col_values=(('qos', UUID('47e36dd0-931a-483e-aa0c-98c7dbb9e376')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45923d58-41, col_values=(('external_ids', {'iface-id': '45923d58-4176-482f-b9c0-6f871c90529c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:d1:3e', 'vm-uuid': 'fb551839-7b5a-4ecd-b9c0-ab53addeaa45'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:04 user nova-compute[75469]: INFO os_vif [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41')
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No VIF found with MAC fa:16:3e:a3:b1:4e, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] No VIF found with MAC fa:16:3e:44:d1:3e, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.network.neutron [req-aadb9bfa-4d39-41ca-9571-67e4f38c673f req-3eeb546b-19ec-44b7-866f-066030d9484f service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Updated VIF entry in instance network info cache for port ae16d917-f1e7-40f3-86cf-ea7150673ddb. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG nova.network.neutron [req-aadb9bfa-4d39-41ca-9571-67e4f38c673f req-3eeb546b-19ec-44b7-866f-066030d9484f service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Updating instance_info_cache with network_info: [{"id": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "address": "fa:16:3e:a3:b1:4e", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae16d917-f1", "ovs_interfaceid": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:56:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aadb9bfa-4d39-41ca-9571-67e4f38c673f req-3eeb546b-19ec-44b7-866f-066030d9484f service nova] Releasing lock "refresh_cache-61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:56:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-cd97e74e-4bd3-47ee-b6e5-b050f694c612 req-b72ea6be-66c4-4515-8b7c-7a9a0ccfbbbe service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cd97e74e-4bd3-47ee-b6e5-b050f694c612 req-b72ea6be-66c4-4515-8b7c-7a9a0ccfbbbe service nova] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cd97e74e-4bd3-47ee-b6e5-b050f694c612 req-b72ea6be-66c4-4515-8b7c-7a9a0ccfbbbe service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cd97e74e-4bd3-47ee-b6e5-b050f694c612 req-b72ea6be-66c4-4515-8b7c-7a9a0ccfbbbe service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-cd97e74e-4bd3-47ee-b6e5-b050f694c612 req-b72ea6be-66c4-4515-8b7c-7a9a0ccfbbbe service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] No waiting events found dispatching network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:05 user nova-compute[75469]: WARNING nova.compute.manager [req-cd97e74e-4bd3-47ee-b6e5-b050f694c612 req-b72ea6be-66c4-4515-8b7c-7a9a0ccfbbbe service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received unexpected event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 for instance with vm_state active and task_state None.
Nov 14 04:56:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] No waiting events found dispatching network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:07 user nova-compute[75469]: WARNING nova.compute.manager [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received unexpected event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb for instance with vm_state building and task_state spawning.
Nov 14 04:56:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] No waiting events found dispatching network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:07 user nova-compute[75469]: WARNING nova.compute.manager [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received unexpected event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb for instance with vm_state building and task_state spawning.
Nov 14 04:56:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:07 user nova-compute[75469]: WARNING nova.compute.manager [req-e8e9fba3-61f1-49e0-87b3-d0c3427d5093 req-267bca09-e280-4778-bfef-7d251a05aed0 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state active and task_state resize_finish.
Nov 14 04:56:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:56:09 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Instance spawned successfully.
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:56:09 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance running successfully.
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Failed to set time: agent not configured {{(pid=75469) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b3ad018-2142-43da-ab00-42f331c12dae tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] finish_migration finished successfully. {{(pid=75469) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-4f9bc4af-7d9d-4039-80e6-b1f9acf16fa9 req-34d22d9b-cfa8-4aaa-b7b2-b02c0d69d110 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4f9bc4af-7d9d-4039-80e6-b1f9acf16fa9 req-34d22d9b-cfa8-4aaa-b7b2-b02c0d69d110 service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4f9bc4af-7d9d-4039-80e6-b1f9acf16fa9 req-34d22d9b-cfa8-4aaa-b7b2-b02c0d69d110 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4f9bc4af-7d9d-4039-80e6-b1f9acf16fa9 req-34d22d9b-cfa8-4aaa-b7b2-b02c0d69d110 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-4f9bc4af-7d9d-4039-80e6-b1f9acf16fa9 req-34d22d9b-cfa8-4aaa-b7b2-b02c0d69d110 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:09 user nova-compute[75469]: WARNING nova.compute.manager [req-4f9bc4af-7d9d-4039-80e6-b1f9acf16fa9 req-34d22d9b-cfa8-4aaa-b7b2-b02c0d69d110 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state active and task_state resize_finish.
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:09 user nova-compute[75469]: INFO nova.compute.manager [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Took 7.76 seconds to spawn the instance on the hypervisor.
Nov 14 04:56:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:56:09 user nova-compute[75469]: INFO nova.compute.manager [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Took 8.86 seconds to build instance.
Nov 14 04:56:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-34b50097-404a-43cc-9a78-51378c0d253f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.974s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "5c7280e0-6117-48b8-8406-276edcc2051c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:29 user nova-compute[75469]: DEBUG nova.compute.manager [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:56:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:29 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:56:29 user nova-compute[75469]: INFO nova.compute.claims [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Claim successful on node user
Nov 14 04:56:30 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG nova.network.neutron [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:56:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:56:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG nova.policy [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30db3f3e090c47d4815bcdc14582ed14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ea2b5d6174cd2a3a71944f907e59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:56:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Creating image(s)
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "/opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "/opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.208s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk 1073741824" returned: 0 in 0.055s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG nova.network.neutron [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Successfully created port: 237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.229s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Cannot resize image /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Ensure instance console log exists: /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG nova.network.neutron [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Successfully updated port: 237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "refresh_cache-5c7280e0-6117-48b8-8406-276edcc2051c" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquired lock "refresh_cache-5c7280e0-6117-48b8-8406-276edcc2051c" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG nova.network.neutron [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-fb7cbaf4-e161-4b83-983f-7c4bcfe2f61e req-1d1167e7-94c6-4ca6-b307-dba7453b610c service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Received event network-changed-237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-fb7cbaf4-e161-4b83-983f-7c4bcfe2f61e req-1d1167e7-94c6-4ca6-b307-dba7453b610c service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Refreshing instance network info cache due to event network-changed-237bd97e-c773-4221-a0e0-ce00162f3336. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:56:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb7cbaf4-e161-4b83-983f-7c4bcfe2f61e req-1d1167e7-94c6-4ca6-b307-dba7453b610c service nova] Acquiring lock "refresh_cache-5c7280e0-6117-48b8-8406-276edcc2051c" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.network.neutron [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.network.neutron [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Updating instance_info_cache with network_info: [{"id": "237bd97e-c773-4221-a0e0-ce00162f3336", "address": "fa:16:3e:9c:01:59", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237bd97e-c7", "ovs_interfaceid": "237bd97e-c773-4221-a0e0-ce00162f3336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Releasing lock "refresh_cache-5c7280e0-6117-48b8-8406-276edcc2051c" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Instance network_info: |[{"id": "237bd97e-c773-4221-a0e0-ce00162f3336", "address": "fa:16:3e:9c:01:59", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237bd97e-c7", "ovs_interfaceid": "237bd97e-c773-4221-a0e0-ce00162f3336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb7cbaf4-e161-4b83-983f-7c4bcfe2f61e req-1d1167e7-94c6-4ca6-b307-dba7453b610c service nova] Acquired lock "refresh_cache-5c7280e0-6117-48b8-8406-276edcc2051c" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.network.neutron [req-fb7cbaf4-e161-4b83-983f-7c4bcfe2f61e req-1d1167e7-94c6-4ca6-b307-dba7453b610c service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Refreshing network info cache for port 237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Start _get_guest_xml network_info=[{"id": "237bd97e-c773-4221-a0e0-ce00162f3336", "address": "fa:16:3e:9c:01:59", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237bd97e-c7", "ovs_interfaceid": "237bd97e-c773-4221-a0e0-ce00162f3336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:56:32 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:32 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-420644135',display_name='tempest-VolumesSnapshotTestJSON-instance-420644135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-420644135',id=16,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGnvH2zrKhCFrJIq/tttnlBM4HTNP6IdMdMORMOWH4pDYlbK17TQH7DO+hPA8D8/BGT40AkPIo6V2zSHOHqlH/i8ePharzhkObWjAJz7lDAbLHbtAs9L7HC/j4JmuhbSw==',key_name='tempest-keypair-1050647762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='600ea2b5d6174cd2a3a71944f907e59a',ramdisk_id='',reservation_id='r-u2hkzjmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-16916651',owner_user_name='tempest-VolumesSnapshotTestJSON-16916651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:56:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30db3f3e090c47d4815bcdc14582ed14',uuid=5c7280e0-6117-48b8-8406-276edcc2051c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "237bd97e-c773-4221-a0e0-ce00162f3336", "address": "fa:16:3e:9c:01:59", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237bd97e-c7", "ovs_interfaceid": "237bd97e-c773-4221-a0e0-ce00162f3336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converting VIF {"id": "237bd97e-c773-4221-a0e0-ce00162f3336", "address": "fa:16:3e:9c:01:59", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237bd97e-c7", "ovs_interfaceid": "237bd97e-c773-4221-a0e0-ce00162f3336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:01:59,bridge_name='br-int',has_traffic_filtering=True,id=237bd97e-c773-4221-a0e0-ce00162f3336,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237bd97e-c7') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.objects.instance [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c7280e0-6117-48b8-8406-276edcc2051c {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:56:32 user nova-compute[75469]:   <uuid>5c7280e0-6117-48b8-8406-276edcc2051c</uuid>
Nov 14 04:56:32 user nova-compute[75469]:   <name>instance-00000010</name>
Nov 14 04:56:32 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:56:32 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:56:32 user nova-compute[75469]:   <metadata>
Nov 14 04:56:32 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:56:32 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:56:32 user nova-compute[75469]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-420644135</nova:name>
Nov 14 04:56:32 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:56:32</nova:creationTime>
Nov 14 04:56:32 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:56:32 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:56:32 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:56:32 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:56:32 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:56:32 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:56:32 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:56:32 user nova-compute[75469]:       <nova:owner>
Nov 14 04:56:32 user nova-compute[75469]:         <nova:user uuid="30db3f3e090c47d4815bcdc14582ed14">tempest-VolumesSnapshotTestJSON-16916651-project-member</nova:user>
Nov 14 04:56:32 user nova-compute[75469]:         <nova:project uuid="600ea2b5d6174cd2a3a71944f907e59a">tempest-VolumesSnapshotTestJSON-16916651</nova:project>
Nov 14 04:56:32 user nova-compute[75469]:       </nova:owner>
Nov 14 04:56:32 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:56:32 user nova-compute[75469]:       <nova:ports>
Nov 14 04:56:32 user nova-compute[75469]:         <nova:port uuid="237bd97e-c773-4221-a0e0-ce00162f3336">
Nov 14 04:56:32 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 04:56:32 user nova-compute[75469]:         </nova:port>
Nov 14 04:56:32 user nova-compute[75469]:       </nova:ports>
Nov 14 04:56:32 user nova-compute[75469]:     </nova:instance>
Nov 14 04:56:32 user nova-compute[75469]:   </metadata>
Nov 14 04:56:32 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:56:32 user nova-compute[75469]:     <system>
Nov 14 04:56:32 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:56:32 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:56:32 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:56:32 user nova-compute[75469]:       <entry name="serial">5c7280e0-6117-48b8-8406-276edcc2051c</entry>
Nov 14 04:56:32 user nova-compute[75469]:       <entry name="uuid">5c7280e0-6117-48b8-8406-276edcc2051c</entry>
Nov 14 04:56:32 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:56:32 user nova-compute[75469]:     </system>
Nov 14 04:56:32 user nova-compute[75469]:   </sysinfo>
Nov 14 04:56:32 user nova-compute[75469]:   <os>
Nov 14 04:56:32 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:56:32 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:56:32 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:56:32 user nova-compute[75469]:   </os>
Nov 14 04:56:32 user nova-compute[75469]:   <features>
Nov 14 04:56:32 user nova-compute[75469]:     <acpi/>
Nov 14 04:56:32 user nova-compute[75469]:     <apic/>
Nov 14 04:56:32 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:56:32 user nova-compute[75469]:   </features>
Nov 14 04:56:32 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:56:32 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:56:32 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:56:32 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:56:32 user nova-compute[75469]:   </clock>
Nov 14 04:56:32 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:56:32 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:56:32 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:56:32 user nova-compute[75469]:   </cpu>
Nov 14 04:56:32 user nova-compute[75469]:   <devices>
Nov 14 04:56:32 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:56:32 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:56:32 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk"/>
Nov 14 04:56:32 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:56:32 user nova-compute[75469]:     </disk>
Nov 14 04:56:32 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:56:32 user nova-compute[75469]:       <mac address="fa:16:3e:9c:01:59"/>
Nov 14 04:56:32 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:56:32 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:56:32 user nova-compute[75469]:       <target dev="tap237bd97e-c7"/>
Nov 14 04:56:32 user nova-compute[75469]:     </interface>
Nov 14 04:56:32 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:56:32 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/console.log" append="off"/>
Nov 14 04:56:32 user nova-compute[75469]:     </serial>
Nov 14 04:56:32 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:56:32 user nova-compute[75469]:     <video>
Nov 14 04:56:32 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:56:32 user nova-compute[75469]:     </video>
Nov 14 04:56:32 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:56:32 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:56:32 user nova-compute[75469]:     </rng>
Nov 14 04:56:32 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:56:32 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:56:32 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:56:32 user nova-compute[75469]:     </memballoon>
Nov 14 04:56:32 user nova-compute[75469]:   </devices>
Nov 14 04:56:32 user nova-compute[75469]: </domain>
Nov 14 04:56:32 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-420644135',display_name='tempest-VolumesSnapshotTestJSON-instance-420644135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-420644135',id=16,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGnvH2zrKhCFrJIq/tttnlBM4HTNP6IdMdMORMOWH4pDYlbK17TQH7DO+hPA8D8/BGT40AkPIo6V2zSHOHqlH/i8ePharzhkObWjAJz7lDAbLHbtAs9L7HC/j4JmuhbSw==',key_name='tempest-keypair-1050647762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='600ea2b5d6174cd2a3a71944f907e59a',ramdisk_id='',reservation_id='r-u2hkzjmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-16916651',owner_user_name='tempest-VolumesSnapshotTestJSON-16916651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:56:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30db3f3e090c47d4815bcdc14582ed14',uuid=5c7280e0-6117-48b8-8406-276edcc2051c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "237bd97e-c773-4221-a0e0-ce00162f3336", "address": "fa:16:3e:9c:01:59", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237bd97e-c7", "ovs_interfaceid": "237bd97e-c773-4221-a0e0-ce00162f3336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converting VIF {"id": "237bd97e-c773-4221-a0e0-ce00162f3336", "address": "fa:16:3e:9c:01:59", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237bd97e-c7", "ovs_interfaceid": "237bd97e-c773-4221-a0e0-ce00162f3336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:01:59,bridge_name='br-int',has_traffic_filtering=True,id=237bd97e-c773-4221-a0e0-ce00162f3336,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237bd97e-c7') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG os_vif [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:01:59,bridge_name='br-int',has_traffic_filtering=True,id=237bd97e-c773-4221-a0e0-ce00162f3336,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237bd97e-c7') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f9a00b9-8d4e-5553-b358-5701c7d4459a', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap237bd97e-c7, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap237bd97e-c7, col_values=(('qos', UUID('130c63d7-c771-4092-8198-1d68f31a36d4')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap237bd97e-c7, col_values=(('external_ids', {'iface-id': '237bd97e-c773-4221-a0e0-ce00162f3336', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:01:59', 'vm-uuid': '5c7280e0-6117-48b8-8406-276edcc2051c'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:32 user nova-compute[75469]: INFO os_vif [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:01:59,bridge_name='br-int',has_traffic_filtering=True,id=237bd97e-c773-4221-a0e0-ce00162f3336,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237bd97e-c7')
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] No VIF found with MAC fa:16:3e:9c:01:59, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.network.neutron [req-fb7cbaf4-e161-4b83-983f-7c4bcfe2f61e req-1d1167e7-94c6-4ca6-b307-dba7453b610c service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Updated VIF entry in instance network info cache for port 237bd97e-c773-4221-a0e0-ce00162f3336. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG nova.network.neutron [req-fb7cbaf4-e161-4b83-983f-7c4bcfe2f61e req-1d1167e7-94c6-4ca6-b307-dba7453b610c service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Updating instance_info_cache with network_info: [{"id": "237bd97e-c773-4221-a0e0-ce00162f3336", "address": "fa:16:3e:9c:01:59", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237bd97e-c7", "ovs_interfaceid": "237bd97e-c773-4221-a0e0-ce00162f3336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:56:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb7cbaf4-e161-4b83-983f-7c4bcfe2f61e req-1d1167e7-94c6-4ca6-b307-dba7453b610c service nova] Releasing lock "refresh_cache-5c7280e0-6117-48b8-8406-276edcc2051c" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:56:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-6461ef31-861b-49cf-bb8a-55983c6a57f7 req-ca7c99f4-9382-410b-b734-a7303fbd41c6 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Received event network-vif-plugged-237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6461ef31-861b-49cf-bb8a-55983c6a57f7 req-ca7c99f4-9382-410b-b734-a7303fbd41c6 service nova] Acquiring lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6461ef31-861b-49cf-bb8a-55983c6a57f7 req-ca7c99f4-9382-410b-b734-a7303fbd41c6 service nova] Lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6461ef31-861b-49cf-bb8a-55983c6a57f7 req-ca7c99f4-9382-410b-b734-a7303fbd41c6 service nova] Lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-6461ef31-861b-49cf-bb8a-55983c6a57f7 req-ca7c99f4-9382-410b-b734-a7303fbd41c6 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] No waiting events found dispatching network-vif-plugged-237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:34 user nova-compute[75469]: WARNING nova.compute.manager [req-6461ef31-861b-49cf-bb8a-55983c6a57f7 req-ca7c99f4-9382-410b-b734-a7303fbd41c6 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Received unexpected event network-vif-plugged-237bd97e-c773-4221-a0e0-ce00162f3336 for instance with vm_state building and task_state spawning.
Nov 14 04:56:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:56:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Instance spawned successfully.
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:36 user nova-compute[75469]: INFO nova.compute.manager [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:56:36 user nova-compute[75469]: INFO nova.compute.manager [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Took 6.82 seconds to build instance.
Nov 14 04:56:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-484c4d05-704c-406a-9141-f2a3474b3314 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.930s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-9adaa122-1097-47f3-b1af-b0aadfe293f3 req-a5bce5ed-9aca-44f1-814e-9362bc31ccba service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Received event network-vif-plugged-237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9adaa122-1097-47f3-b1af-b0aadfe293f3 req-a5bce5ed-9aca-44f1-814e-9362bc31ccba service nova] Acquiring lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9adaa122-1097-47f3-b1af-b0aadfe293f3 req-a5bce5ed-9aca-44f1-814e-9362bc31ccba service nova] Lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9adaa122-1097-47f3-b1af-b0aadfe293f3 req-a5bce5ed-9aca-44f1-814e-9362bc31ccba service nova] Lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-9adaa122-1097-47f3-b1af-b0aadfe293f3 req-a5bce5ed-9aca-44f1-814e-9362bc31ccba service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] No waiting events found dispatching network-vif-plugged-237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:36 user nova-compute[75469]: WARNING nova.compute.manager [req-9adaa122-1097-47f3-b1af-b0aadfe293f3 req-a5bce5ed-9aca-44f1-814e-9362bc31ccba service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Received unexpected event network-vif-plugged-237bd97e-c773-4221-a0e0-ce00162f3336 for instance with vm_state active and task_state None.
Nov 14 04:56:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:38 user nova-compute[75469]: INFO nova.compute.manager [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Rescuing
Nov 14 04:56:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:56:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquired lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:56:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:56:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:39 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updating instance_info_cache with network_info: [{"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:56:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Releasing lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:56:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-b39596bb-c88e-4090-8839-c4bf74abf12d req-b759d1ae-5127-4536-857f-76ad6ee0405a service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-unplugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b39596bb-c88e-4090-8839-c4bf74abf12d req-b759d1ae-5127-4536-857f-76ad6ee0405a service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b39596bb-c88e-4090-8839-c4bf74abf12d req-b759d1ae-5127-4536-857f-76ad6ee0405a service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b39596bb-c88e-4090-8839-c4bf74abf12d req-b759d1ae-5127-4536-857f-76ad6ee0405a service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-b39596bb-c88e-4090-8839-c4bf74abf12d req-b759d1ae-5127-4536-857f-76ad6ee0405a service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-unplugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:40 user nova-compute[75469]: WARNING nova.compute.manager [req-b39596bb-c88e-4090-8839-c4bf74abf12d req-b759d1ae-5127-4536-857f-76ad6ee0405a service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received unexpected event network-vif-unplugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with vm_state active and task_state rescuing.
Nov 14 04:56:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:40 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Instance destroyed successfully.
Nov 14 04:56:40 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Attempting a stable device rescue
Nov 14 04:56:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Instance directory exists: not creating {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 04:56:40 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Creating image(s)
Nov 14 04:56:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "/opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "/opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "/opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'trusted_certs' on Instance uuid 929364ea-9d56-41ff-a393-8abd7df60eec {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "1e57e18ba65f1c946e4152d312ea9966f2bfc2ad" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "1e57e18ba65f1c946e4152d312ea9966f2bfc2ad" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad.part --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-96b82748-d1c8-4a86-9045-534f8455be3a req-6f6f7922-60f3-4a16-80cc-ffabd9820e23 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-96b82748-d1c8-4a86-9045-534f8455be3a req-6f6f7922-60f3-4a16-80cc-ffabd9820e23 service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-96b82748-d1c8-4a86-9045-534f8455be3a req-6f6f7922-60f3-4a16-80cc-ffabd9820e23 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-96b82748-d1c8-4a86-9045-534f8455be3a req-6f6f7922-60f3-4a16-80cc-ffabd9820e23 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-96b82748-d1c8-4a86-9045-534f8455be3a req-6f6f7922-60f3-4a16-80cc-ffabd9820e23 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:42 user nova-compute[75469]: WARNING nova.compute.manager [req-96b82748-d1c8-4a86-9045-534f8455be3a req-6f6f7922-60f3-4a16-80cc-ffabd9820e23 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received unexpected event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with vm_state active and task_state rescuing.
Nov 14 04:56:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG nova.virt.images [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] 2091253a-baea-4b1b-9f19-096585e8b3bf was qcow2, converting to raw {{(pid=75469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad.part /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad.converted {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad.part /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad.converted" returned: 0 in 0.609s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad.converted --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "1e57e18ba65f1c946e4152d312ea9966f2bfc2ad" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.483s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "1e57e18ba65f1c946e4152d312ea9966f2bfc2ad" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "1e57e18ba65f1c946e4152d312ea9966f2bfc2ad" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad,backing_fmt=raw /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.rescue {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad,backing_fmt=raw /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.rescue" returned: 0 in 0.055s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "1e57e18ba65f1c946e4152d312ea9966f2bfc2ad" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'migration_context' on Instance uuid 929364ea-9d56-41ff-a393-8abd7df60eec {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.objects.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Object Instance<929364ea-9d56-41ff-a393-8abd7df60eec> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Start _get_guest_xml network_info=[{"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "vif_mac": "fa:16:3e:c3:04:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2091253a-baea-4b1b-9f19-096585e8b3bf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '3eed3e3b-e72e-470c-8795-ad2281bfed53', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMLfgOGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '929364ea-9d56-41ff-a393-8abd7df60eec', 'attached_at': '', 'detached_at': '', 'volume_id': '1e607621-505d-441b-869a-10a26d80e970', 'serial': '1e607621-505d-441b-869a-10a26d80e970'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'resources' on Instance uuid 929364ea-9d56-41ff-a393-8abd7df60eec {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.objects.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Object Instance<929364ea-9d56-41ff-a393-8abd7df60eec> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'numa_topology' on Instance uuid 929364ea-9d56-41ff-a393-8abd7df60eec {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.objects.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Object Instance<929364ea-9d56-41ff-a393-8abd7df60eec> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:56:43 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:43 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'vcpu_model' on Instance uuid 929364ea-9d56-41ff-a393-8abd7df60eec {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.objects.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Object Instance<929364ea-9d56-41ff-a393-8abd7df60eec> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMLfgOGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:56:43 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:56:43 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:56:43 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e68691-46b5-4810-8d4f-1acf56d59726]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = uMLfgOGB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 04:56:43 user nova-compute[75469]: node.name = iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 04:56:43 user nova-compute[75469]: node.tpgt = -1
Nov 14 04:56:43 user nova-compute[75469]: node.startup = automatic
Nov 14 04:56:43 user nova-compute[75469]: node.leading_login = No
Nov 14 04:56:43 user nova-compute[75469]: iface.iscsi_ifacename = default
Nov 14 04:56:43 user nova-compute[75469]: iface.net_ifacename = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.ipaddress = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.prefix_len = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.hwaddress = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.transport_name = tcp
Nov 14 04:56:43 user nova-compute[75469]: iface.initiatorname = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.state = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.vlan_id = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.vlan_priority = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.vlan_state = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.iface_num = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.mtu = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.port = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.bootproto = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.subnet_mask = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.gateway = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.dhcp_alt_client_id = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.dhcp_dns = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.dhcp_learn_iqn = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.dhcp_vendor_id_state = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.dhcp_vendor_id = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.dhcp_slp_da = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.fragmentation = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.gratuitous_arp = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.incoming_forwarding = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.tos_state = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.tos = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.ttl = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.delayed_ack = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.tcp_nagle = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.tcp_wsf_state = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.tcp_wsf = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.tcp_timer_scale = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.tcp_timestamp = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.redirect = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.def_task_mgmt_timeout = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.header_digest = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.data_digest = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.immediate_data = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.initial_r2t = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.data_seq_inorder = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.data_pdu_inorder = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.erl = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.max_receive_data_len = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.first_burst_len = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.max_outstanding_r2t = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.max_burst_len = 0
Nov 14 04:56:43 user nova-compute[75469]: iface.chap_auth = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.bidi_chap = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.strict_login_compliance = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.discovery_auth = <empty>
Nov 14 04:56:43 user nova-compute[75469]: iface.discovery_logout = <empty>
Nov 14 04:56:43 user nova-compute[75469]: node.discovery_address = <empty>
Nov 14 04:56:43 user nova-compute[75469]: node.discovery_port = 0
Nov 14 04:56:43 user nova-compute[75469]: node.discovery_type = static
Nov 14 04:56:43 user nova-compute[75469]: node.session.initial_cmdsn = 0
Nov 14 04:56:43 user nova-compute[75469]: node.session.initial_login_retry_max = 8
Nov 14 04:56:43 user nova-compute[75469]: node.session.xmit_thread_priority = -20
Nov 14 04:56:43 user nova-compute[75469]: node.session.cmds_max = 128
Nov 14 04:56:43 user nova-compute[75469]: node.session.queue_depth = 32
Nov 14 04:56:43 user nova-compute[75469]: node.session.nr_sessions = 1
Nov 14 04:56:43 user nova-compute[75469]: node.session.auth.authmethod = CHAP
Nov 14 04:56:43 user nova-compute[75469]: node.session.auth.username = uMLfgOGB
Nov 14 04:56:43 user nova-compute[75469]: node.session.auth.password = ***
Nov 14 04:56:43 user nova-compute[75469]: node.session.auth.username_in = <empty>
Nov 14 04:56:43 user nova-compute[75469]: node.session.auth.password_in = <empty>
Nov 14 04:56:43 user nova-compute[75469]: node.session.auth.chap_algs = MD5
Nov 14 04:56:43 user nova-compute[75469]: node.session.timeo.replacement_timeout = 120
Nov 14 04:56:43 user nova-compute[75469]: node.session.err_timeo.abort_timeout = 15
Nov 14 04:56:43 user nova-compute[75469]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 04:56:43 user nova-compute[75469]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 04:56:43 user nova-compute[75469]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 04:56:43 user nova-compute[75469]: node.session.iscsi.FastAbort = Yes
Nov 14 04:56:43 user nova-compute[75469]: node.session.iscsi.InitialR2T = No
Nov 14 04:56:43 user nova-compute[75469]: node.session.iscsi.ImmediateData = Yes
Nov 14 04:56:43 user nova-compute[75469]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 04:56:43 user nova-compute[75469]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 04:56:43 user nova-compute[75469]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 04:56:43 user nova-compute[75469]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 04:56:43 user nova-compute[75469]: node.session.iscsi.MaxConnections = 1
Nov 14 04:56:43 user nova-compute[75469]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 04:56:43 user nova-compute[75469]: node.session.iscsi.ERL = 0
Nov 14 04:56:43 user nova-compute[75469]: node.session.scan = manual
Nov 14 04:56:43 user nova-compute[75469]: node.session.reopen_max = 0
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].address = 172.16.0.220
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].port = 3260
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].startup = manual
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].tcp.window_size = 524288
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].tcp.type_of_service = 0
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].timeo.logout_timeout = 15
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].timeo.login_timeout = 15
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].timeo.auth_timeout = 45
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].iscsi.DataDigest = None
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].iscsi.IFMarker = No
Nov 14 04:56:43 user nova-compute[75469]: node.conn[0].iscsi.OFMarker = No
Nov 14 04:56:43 user nova-compute[75469]: # END RECORD
Nov 14 04:56:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b992e3-3d63-47c1-8a38-48269cc45a84]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb739042-5758-429b-9201-2301b941be37]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMLfgOGB {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMLfgOGB" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3afca6b-dbda-4110-8d5b-4b70305c9c97]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uMLfgOGB'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35d9fcb-a2fe-46d5-86dd-352a7e0ec0dd]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e904676f-15e8-4f27-b381-76c129c1c0bb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:56:43 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:56:43 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:56:43 user nova-compute[75469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:56:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:56:43 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:56:43 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:56:43 user nova-compute[75469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:56:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.191s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] HCTL ('34', '0', '0', 0) found on session 17 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63d4f4b-1db1-4200-8404-f186f2d883a7]: (4, ('0 0 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching for a device in session 17 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMLfgOGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.219s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] <== connect_volume: return (220ms) {'type': 'block', 'scsi_wwn': '23963323036636239', 'path': '/dev/sdc'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963323036636239', 'path': '/dev/sdc'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2102515421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2102515421',id=13,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:55:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-lwtjrbx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:55:04Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=929364ea-9d56-41ff-a393-8abd7df60eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "vif_mac": "fa:16:3e:c3:04:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "vif_mac": "fa:16:3e:c3:04:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:04:a0,bridge_name='br-int',has_traffic_filtering=True,id=44003f19-d7b1-4227-bbef-774fb01f1431,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44003f19-d7') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'pci_devices' on Instance uuid 929364ea-9d56-41ff-a393-8abd7df60eec {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.objects.base [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Object Instance<929364ea-9d56-41ff-a393-8abd7df60eec> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:56:43 user nova-compute[75469]:   <uuid>929364ea-9d56-41ff-a393-8abd7df60eec</uuid>
Nov 14 04:56:43 user nova-compute[75469]:   <name>instance-0000000d</name>
Nov 14 04:56:43 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:56:43 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:56:43 user nova-compute[75469]:   <metadata>
Nov 14 04:56:43 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:56:43 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:56:43 user nova-compute[75469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2102515421</nova:name>
Nov 14 04:56:43 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:56:43</nova:creationTime>
Nov 14 04:56:43 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:56:43 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:56:43 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:56:43 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:56:43 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:56:43 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:56:43 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:56:43 user nova-compute[75469]:       <nova:owner>
Nov 14 04:56:43 user nova-compute[75469]:         <nova:user uuid="3a23a8feda3e4d7581666ca3ee20aa5f">tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member</nova:user>
Nov 14 04:56:43 user nova-compute[75469]:         <nova:project uuid="e392b9dd841a4eacab6c4aff4f60e536">tempest-ServerBootFromVolumeStableRescueTest-1634984639</nova:project>
Nov 14 04:56:43 user nova-compute[75469]:       </nova:owner>
Nov 14 04:56:43 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:56:43 user nova-compute[75469]:       <nova:ports>
Nov 14 04:56:43 user nova-compute[75469]:         <nova:port uuid="44003f19-d7b1-4227-bbef-774fb01f1431">
Nov 14 04:56:43 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 04:56:43 user nova-compute[75469]:         </nova:port>
Nov 14 04:56:43 user nova-compute[75469]:       </nova:ports>
Nov 14 04:56:43 user nova-compute[75469]:     </nova:instance>
Nov 14 04:56:43 user nova-compute[75469]:   </metadata>
Nov 14 04:56:43 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:56:43 user nova-compute[75469]:     <system>
Nov 14 04:56:43 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:56:43 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:56:43 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:56:43 user nova-compute[75469]:       <entry name="serial">929364ea-9d56-41ff-a393-8abd7df60eec</entry>
Nov 14 04:56:43 user nova-compute[75469]:       <entry name="uuid">929364ea-9d56-41ff-a393-8abd7df60eec</entry>
Nov 14 04:56:43 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:56:43 user nova-compute[75469]:     </system>
Nov 14 04:56:43 user nova-compute[75469]:   </sysinfo>
Nov 14 04:56:43 user nova-compute[75469]:   <os>
Nov 14 04:56:43 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:56:43 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:56:43 user nova-compute[75469]:   </os>
Nov 14 04:56:43 user nova-compute[75469]:   <features>
Nov 14 04:56:43 user nova-compute[75469]:     <acpi/>
Nov 14 04:56:43 user nova-compute[75469]:     <apic/>
Nov 14 04:56:43 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:56:43 user nova-compute[75469]:   </features>
Nov 14 04:56:43 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:56:43 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:56:43 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:56:43 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:56:43 user nova-compute[75469]:   </clock>
Nov 14 04:56:43 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:56:43 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:56:43 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:56:43 user nova-compute[75469]:   </cpu>
Nov 14 04:56:43 user nova-compute[75469]:   <devices>
Nov 14 04:56:43 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:56:43 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:56:43 user nova-compute[75469]:       <source dev="/dev/sdc"/>
Nov 14 04:56:43 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:56:43 user nova-compute[75469]:       <serial>1e607621-505d-441b-869a-10a26d80e970</serial>
Nov 14 04:56:43 user nova-compute[75469]:     </disk>
Nov 14 04:56:43 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:56:43 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:56:43 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.rescue"/>
Nov 14 04:56:43 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 04:56:43 user nova-compute[75469]:       <boot order="1"/>
Nov 14 04:56:43 user nova-compute[75469]:     </disk>
Nov 14 04:56:43 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:56:43 user nova-compute[75469]:       <mac address="fa:16:3e:c3:04:a0"/>
Nov 14 04:56:43 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:56:43 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:56:43 user nova-compute[75469]:       <target dev="tap44003f19-d7"/>
Nov 14 04:56:43 user nova-compute[75469]:     </interface>
Nov 14 04:56:43 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:56:43 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/console.log" append="off"/>
Nov 14 04:56:43 user nova-compute[75469]:     </serial>
Nov 14 04:56:43 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:56:43 user nova-compute[75469]:     <video>
Nov 14 04:56:43 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:56:43 user nova-compute[75469]:     </video>
Nov 14 04:56:43 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:56:43 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:56:43 user nova-compute[75469]:     </rng>
Nov 14 04:56:43 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:56:43 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:56:43 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:56:43 user nova-compute[75469]:     </memballoon>
Nov 14 04:56:43 user nova-compute[75469]:   </devices>
Nov 14 04:56:43 user nova-compute[75469]: </domain>
Nov 14 04:56:43 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:56:43 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Instance destroyed successfully.
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:56:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No VIF found with MAC fa:16:3e:c3:04:a0, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:56:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Acquiring lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:56:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:44 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:56:44 user nova-compute[75469]: INFO nova.compute.claims [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Claim successful on node user
Nov 14 04:56:44 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:56:44 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:56:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:56:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:56:44 user nova-compute[75469]: DEBUG nova.network.neutron [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:56:44 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:56:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:56:45 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Creating image(s)
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Acquiring lock "/opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "/opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "/opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG nova.policy [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '265ebcebef7042559725423cb19361e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dfc8ceb83472c9fb44a09893a882c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.252s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk 1073741824" returned: 0 in 0.068s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-33928023-aa78-4ff8-8859-7ba6e894cacd req-da8e8964-3abf-414b-a994-2ad10c123dea service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-33928023-aa78-4ff8-8859-7ba6e894cacd req-da8e8964-3abf-414b-a994-2ad10c123dea service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-33928023-aa78-4ff8-8859-7ba6e894cacd req-da8e8964-3abf-414b-a994-2ad10c123dea service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-33928023-aa78-4ff8-8859-7ba6e894cacd req-da8e8964-3abf-414b-a994-2ad10c123dea service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-33928023-aa78-4ff8-8859-7ba6e894cacd req-da8e8964-3abf-414b-a994-2ad10c123dea service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:45 user nova-compute[75469]: WARNING nova.compute.manager [req-33928023-aa78-4ff8-8859-7ba6e894cacd req-da8e8964-3abf-414b-a994-2ad10c123dea service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received unexpected event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with vm_state active and task_state rescuing.
Nov 14 04:56:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.234s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:56:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Cannot resize image /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Ensure instance console log exists: /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating instance_info_cache with network_info: [{"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-fbbae8e3-5d56-41ed-9be2-8856c3420f44" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Successfully created port: bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Successfully updated port: bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Acquiring lock "refresh_cache-89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Acquired lock "refresh_cache-89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-198efb7f-2a65-4b05-93ed-160ca5d8d642 req-060d3411-d358-4eb4-bcb8-cf9044f41c6e service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Received event network-changed-bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-198efb7f-2a65-4b05-93ed-160ca5d8d642 req-060d3411-d358-4eb4-bcb8-cf9044f41c6e service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Refreshing instance network info cache due to event network-changed-bf891eef-8760-465c-9987-402d1604700f. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-198efb7f-2a65-4b05-93ed-160ca5d8d642 req-060d3411-d358-4eb4-bcb8-cf9044f41c6e service nova] Acquiring lock "refresh_cache-89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:56:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.network.neutron [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Updating instance_info_cache with network_info: [{"id": "bf891eef-8760-465c-9987-402d1604700f", "address": "fa:16:3e:0e:de:0e", "network": {"id": "03767120-d39f-4b62-ab5c-16a0194f6699", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f70bea45417a48dfbf060641403e50f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf891eef-87", "ovs_interfaceid": "bf891eef-8760-465c-9987-402d1604700f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Releasing lock "refresh_cache-89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.compute.manager [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Instance network_info: |[{"id": "bf891eef-8760-465c-9987-402d1604700f", "address": "fa:16:3e:0e:de:0e", "network": {"id": "03767120-d39f-4b62-ab5c-16a0194f6699", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f70bea45417a48dfbf060641403e50f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf891eef-87", "ovs_interfaceid": "bf891eef-8760-465c-9987-402d1604700f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-198efb7f-2a65-4b05-93ed-160ca5d8d642 req-060d3411-d358-4eb4-bcb8-cf9044f41c6e service nova] Acquired lock "refresh_cache-89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.network.neutron [req-198efb7f-2a65-4b05-93ed-160ca5d8d642 req-060d3411-d358-4eb4-bcb8-cf9044f41c6e service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Refreshing network info cache for port bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Start _get_guest_xml network_info=[{"id": "bf891eef-8760-465c-9987-402d1604700f", "address": "fa:16:3e:0e:de:0e", "network": {"id": "03767120-d39f-4b62-ab5c-16a0194f6699", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f70bea45417a48dfbf060641403e50f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf891eef-87", "ovs_interfaceid": "bf891eef-8760-465c-9987-402d1604700f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:56:47 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:47 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1089345000',display_name='tempest-VolumesNegativeTest-instance-1089345000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1089345000',id=17,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d4dfc8ceb83472c9fb44a09893a882c',ramdisk_id='',reservation_id='r-x7p2fw9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2114881959',owner_user_name='tempest-VolumesNegativeTest-2114881959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:56:45Z,user_data=None,user_id='265ebcebef7042559725423cb19361e7',uuid=89b01b8e-de64-4c2f-b5f8-b717b0fd16ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf891eef-8760-465c-9987-402d1604700f", "address": "fa:16:3e:0e:de:0e", "network": {"id": "03767120-d39f-4b62-ab5c-16a0194f6699", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f70bea45417a48dfbf060641403e50f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf891eef-87", "ovs_interfaceid": "bf891eef-8760-465c-9987-402d1604700f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Converting VIF {"id": "bf891eef-8760-465c-9987-402d1604700f", "address": "fa:16:3e:0e:de:0e", "network": {"id": "03767120-d39f-4b62-ab5c-16a0194f6699", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f70bea45417a48dfbf060641403e50f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf891eef-87", "ovs_interfaceid": "bf891eef-8760-465c-9987-402d1604700f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:de:0e,bridge_name='br-int',has_traffic_filtering=True,id=bf891eef-8760-465c-9987-402d1604700f,network=Network(03767120-d39f-4b62-ab5c-16a0194f6699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf891eef-87') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.objects.instance [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lazy-loading 'pci_devices' on Instance uuid 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:56:47 user nova-compute[75469]:   <uuid>89b01b8e-de64-4c2f-b5f8-b717b0fd16ce</uuid>
Nov 14 04:56:47 user nova-compute[75469]:   <name>instance-00000011</name>
Nov 14 04:56:47 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:56:47 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:56:47 user nova-compute[75469]:   <metadata>
Nov 14 04:56:47 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:56:47 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:56:47 user nova-compute[75469]:       <nova:name>tempest-VolumesNegativeTest-instance-1089345000</nova:name>
Nov 14 04:56:47 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:56:47</nova:creationTime>
Nov 14 04:56:47 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:56:47 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:56:47 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:56:47 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:56:47 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:56:47 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:56:47 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:56:47 user nova-compute[75469]:       <nova:owner>
Nov 14 04:56:47 user nova-compute[75469]:         <nova:user uuid="265ebcebef7042559725423cb19361e7">tempest-VolumesNegativeTest-2114881959-project-member</nova:user>
Nov 14 04:56:47 user nova-compute[75469]:         <nova:project uuid="7d4dfc8ceb83472c9fb44a09893a882c">tempest-VolumesNegativeTest-2114881959</nova:project>
Nov 14 04:56:47 user nova-compute[75469]:       </nova:owner>
Nov 14 04:56:47 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:56:47 user nova-compute[75469]:       <nova:ports>
Nov 14 04:56:47 user nova-compute[75469]:         <nova:port uuid="bf891eef-8760-465c-9987-402d1604700f">
Nov 14 04:56:47 user nova-compute[75469]:           <nova:ip type="fixed" address="192.168.233.6" ipVersion="4"/>
Nov 14 04:56:47 user nova-compute[75469]:         </nova:port>
Nov 14 04:56:47 user nova-compute[75469]:       </nova:ports>
Nov 14 04:56:47 user nova-compute[75469]:     </nova:instance>
Nov 14 04:56:47 user nova-compute[75469]:   </metadata>
Nov 14 04:56:47 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:56:47 user nova-compute[75469]:     <system>
Nov 14 04:56:47 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:56:47 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:56:47 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:56:47 user nova-compute[75469]:       <entry name="serial">89b01b8e-de64-4c2f-b5f8-b717b0fd16ce</entry>
Nov 14 04:56:47 user nova-compute[75469]:       <entry name="uuid">89b01b8e-de64-4c2f-b5f8-b717b0fd16ce</entry>
Nov 14 04:56:47 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:56:47 user nova-compute[75469]:     </system>
Nov 14 04:56:47 user nova-compute[75469]:   </sysinfo>
Nov 14 04:56:47 user nova-compute[75469]:   <os>
Nov 14 04:56:47 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:56:47 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:56:47 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:56:47 user nova-compute[75469]:   </os>
Nov 14 04:56:47 user nova-compute[75469]:   <features>
Nov 14 04:56:47 user nova-compute[75469]:     <acpi/>
Nov 14 04:56:47 user nova-compute[75469]:     <apic/>
Nov 14 04:56:47 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:56:47 user nova-compute[75469]:   </features>
Nov 14 04:56:47 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:56:47 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:56:47 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:56:47 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:56:47 user nova-compute[75469]:   </clock>
Nov 14 04:56:47 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:56:47 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:56:47 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:56:47 user nova-compute[75469]:   </cpu>
Nov 14 04:56:47 user nova-compute[75469]:   <devices>
Nov 14 04:56:47 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:56:47 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:56:47 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk"/>
Nov 14 04:56:47 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:56:47 user nova-compute[75469]:     </disk>
Nov 14 04:56:47 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:56:47 user nova-compute[75469]:       <mac address="fa:16:3e:0e:de:0e"/>
Nov 14 04:56:47 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:56:47 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:56:47 user nova-compute[75469]:       <target dev="tapbf891eef-87"/>
Nov 14 04:56:47 user nova-compute[75469]:     </interface>
Nov 14 04:56:47 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:56:47 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/console.log" append="off"/>
Nov 14 04:56:47 user nova-compute[75469]:     </serial>
Nov 14 04:56:47 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:56:47 user nova-compute[75469]:     <video>
Nov 14 04:56:47 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:56:47 user nova-compute[75469]:     </video>
Nov 14 04:56:47 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:56:47 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:56:47 user nova-compute[75469]:     </rng>
Nov 14 04:56:47 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:56:47 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:56:47 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:56:47 user nova-compute[75469]:     </memballoon>
Nov 14 04:56:47 user nova-compute[75469]:   </devices>
Nov 14 04:56:47 user nova-compute[75469]: </domain>
Nov 14 04:56:47 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1089345000',display_name='tempest-VolumesNegativeTest-instance-1089345000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1089345000',id=17,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d4dfc8ceb83472c9fb44a09893a882c',ramdisk_id='',reservation_id='r-x7p2fw9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2114881959',owner_user_name='tempest-VolumesNegativeTest-2114881959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:56:45Z,user_data=None,user_id='265ebcebef7042559725423cb19361e7',uuid=89b01b8e-de64-4c2f-b5f8-b717b0fd16ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf891eef-8760-465c-9987-402d1604700f", "address": "fa:16:3e:0e:de:0e", "network": {"id": "03767120-d39f-4b62-ab5c-16a0194f6699", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f70bea45417a48dfbf060641403e50f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf891eef-87", "ovs_interfaceid": "bf891eef-8760-465c-9987-402d1604700f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Converting VIF {"id": "bf891eef-8760-465c-9987-402d1604700f", "address": "fa:16:3e:0e:de:0e", "network": {"id": "03767120-d39f-4b62-ab5c-16a0194f6699", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f70bea45417a48dfbf060641403e50f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf891eef-87", "ovs_interfaceid": "bf891eef-8760-465c-9987-402d1604700f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:de:0e,bridge_name='br-int',has_traffic_filtering=True,id=bf891eef-8760-465c-9987-402d1604700f,network=Network(03767120-d39f-4b62-ab5c-16a0194f6699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf891eef-87') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG os_vif [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:de:0e,bridge_name='br-int',has_traffic_filtering=True,id=bf891eef-8760-465c-9987-402d1604700f,network=Network(03767120-d39f-4b62-ab5c-16a0194f6699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf891eef-87') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1547434-e3d7-5c1c-bbd7-8ed2c84cff33', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf891eef-87, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf891eef-87, col_values=(('qos', UUID('7d9e4293-7bf2-4b8b-acad-c86541ba3b1f')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf891eef-87, col_values=(('external_ids', {'iface-id': 'bf891eef-8760-465c-9987-402d1604700f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:de:0e', 'vm-uuid': '89b01b8e-de64-4c2f-b5f8-b717b0fd16ce'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:47 user nova-compute[75469]: INFO os_vif [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:de:0e,bridge_name='br-int',has_traffic_filtering=True,id=bf891eef-8760-465c-9987-402d1604700f,network=Network(03767120-d39f-4b62-ab5c-16a0194f6699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf891eef-87')
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] No VIF found with MAC fa:16:3e:0e:de:0e, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-e63400bb-9548-442a-982b-b9035695d707 req-56b59db9-09df-4d54-abee-f87054ca03b8 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e63400bb-9548-442a-982b-b9035695d707 req-56b59db9-09df-4d54-abee-f87054ca03b8 service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e63400bb-9548-442a-982b-b9035695d707 req-56b59db9-09df-4d54-abee-f87054ca03b8 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e63400bb-9548-442a-982b-b9035695d707 req-56b59db9-09df-4d54-abee-f87054ca03b8 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-e63400bb-9548-442a-982b-b9035695d707 req-56b59db9-09df-4d54-abee-f87054ca03b8 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:47 user nova-compute[75469]: WARNING nova.compute.manager [req-e63400bb-9548-442a-982b-b9035695d707 req-56b59db9-09df-4d54-abee-f87054ca03b8 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received unexpected event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with vm_state active and task_state rescuing.
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4522b33d-cdd5-4cde-923e-1c41c419a284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.network.neutron [req-198efb7f-2a65-4b05-93ed-160ca5d8d642 req-060d3411-d358-4eb4-bcb8-cf9044f41c6e service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Updated VIF entry in instance network info cache for port bf891eef-8760-465c-9987-402d1604700f. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG nova.network.neutron [req-198efb7f-2a65-4b05-93ed-160ca5d8d642 req-060d3411-d358-4eb4-bcb8-cf9044f41c6e service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Updating instance_info_cache with network_info: [{"id": "bf891eef-8760-465c-9987-402d1604700f", "address": "fa:16:3e:0e:de:0e", "network": {"id": "03767120-d39f-4b62-ab5c-16a0194f6699", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f70bea45417a48dfbf060641403e50f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf891eef-87", "ovs_interfaceid": "bf891eef-8760-465c-9987-402d1604700f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:56:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-198efb7f-2a65-4b05-93ed-160ca5d8d642 req-060d3411-d358-4eb4-bcb8-cf9044f41c6e service nova] Releasing lock "refresh_cache-89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:56:48 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:56:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-6c041dce-056e-47ed-9684-74904c139166 req-613b5de7-9c47-40e6-80b9-699ec7df9a7c service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Received event network-vif-plugged-bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6c041dce-056e-47ed-9684-74904c139166 req-613b5de7-9c47-40e6-80b9-699ec7df9a7c service nova] Acquiring lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6c041dce-056e-47ed-9684-74904c139166 req-613b5de7-9c47-40e6-80b9-699ec7df9a7c service nova] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6c041dce-056e-47ed-9684-74904c139166 req-613b5de7-9c47-40e6-80b9-699ec7df9a7c service nova] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-6c041dce-056e-47ed-9684-74904c139166 req-613b5de7-9c47-40e6-80b9-699ec7df9a7c service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] No waiting events found dispatching network-vif-plugged-bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:49 user nova-compute[75469]: WARNING nova.compute.manager [req-6c041dce-056e-47ed-9684-74904c139166 req-613b5de7-9c47-40e6-80b9-699ec7df9a7c service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Received unexpected event network-vif-plugged-bf891eef-8760-465c-9987-402d1604700f for instance with vm_state building and task_state spawning.
Nov 14 04:56:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-73dcc74d-002a-40d3-9f3a-d586ca6b88eb req-2a55d604-31ea-4830-b301-6d0aa8be21aa service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Received event network-vif-plugged-bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-73dcc74d-002a-40d3-9f3a-d586ca6b88eb req-2a55d604-31ea-4830-b301-6d0aa8be21aa service nova] Acquiring lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-73dcc74d-002a-40d3-9f3a-d586ca6b88eb req-2a55d604-31ea-4830-b301-6d0aa8be21aa service nova] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-73dcc74d-002a-40d3-9f3a-d586ca6b88eb req-2a55d604-31ea-4830-b301-6d0aa8be21aa service nova] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-73dcc74d-002a-40d3-9f3a-d586ca6b88eb req-2a55d604-31ea-4830-b301-6d0aa8be21aa service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] No waiting events found dispatching network-vif-plugged-bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:51 user nova-compute[75469]: WARNING nova.compute.manager [req-73dcc74d-002a-40d3-9f3a-d586ca6b88eb req-2a55d604-31ea-4830-b301-6d0aa8be21aa service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Received unexpected event network-vif-plugged-bf891eef-8760-465c-9987-402d1604700f for instance with vm_state building and task_state spawning.
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:56:51 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Instance spawned successfully.
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:56:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:51 user nova-compute[75469]: INFO nova.compute.manager [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 14 04:56:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:56:52 user nova-compute[75469]: INFO nova.compute.manager [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Took 7.93 seconds to build instance.
Nov 14 04:56:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-06c06b7e-69c4-47dc-969e-67513b8d81a5 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.056s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json" returned: 0 in 0.341s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:56:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:56:55 user nova-compute[75469]: INFO nova.compute.claims [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Claim successful on node user
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:56:56 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:56:56 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:56:56 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Creating image(s)
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "/opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "/opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.219s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG nova.policy [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5082710327f40249242020afcfe1b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019d303cd8c4aaca04142c29797192f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:56:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.762s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7573MB free_disk=25.167800903320312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk 1073741824" returned: 0 in 0.220s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.989s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.215s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Successfully created port: bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Applying migration context for instance fb551839-7b5a-4ecd-b9c0-ab53addeaa45 as it has an incoming, in-progress migration e209f1ff-4fff-46a3-8c86-bd11e783e5d2. Migration status is finished {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 04:56:57 user nova-compute[75469]: INFO nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating resource usage from migration e209f1ff-4fff-46a3-8c86-bd11e783e5d2
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "73091efc-4129-40a8-8d82-c852ac6fa0c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:57 user nova-compute[75469]: INFO nova.compute.manager [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Terminating instance
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 0faef65d-62e0-4d48-92d5-f50395b7d190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 73091efc-4129-40a8-8d82-c852ac6fa0c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fbbae8e3-5d56-41ed-9be2-8856c3420f44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Migration e209f1ff-4fff-46a3-8c86-bd11e783e5d2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fb551839-7b5a-4ecd-b9c0-ab53addeaa45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 5c7280e0-6117-48b8-8406-276edcc2051c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c0ca77d2-8353-4dfc-beed-ac479535b5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Cannot resize image /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Ensure instance console log exists: /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.172s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Instance destroyed successfully.
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.objects.instance [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lazy-loading 'resources' on Instance uuid 73091efc-4129-40a8-8d82-c852ac6fa0c5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-857984884',display_name='tempest-VolumesAdminNegativeTest-server-857984884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-857984884',id=14,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:55:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94c2c1e6fdb7497aab43cd768f8ea236',ramdisk_id='',reservation_id='r-5umusk90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1455966896',owner_user_name='tempest-VolumesAdminNegativeTest-1455966896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:55:10Z,user_data=None,user_id='cb5695c4e5d74c269678220aa4e1b9bf',uuid=73091efc-4129-40a8-8d82-c852ac6fa0c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "address": "fa:16:3e:c7:03:17", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f44f0b-f5", "ovs_interfaceid": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converting VIF {"id": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "address": "fa:16:3e:c7:03:17", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f44f0b-f5", "ovs_interfaceid": "27f44f0b-f5e3-4ba9-a320-c41109cb8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:03:17,bridge_name='br-int',has_traffic_filtering=True,id=27f44f0b-f5e3-4ba9-a320-c41109cb8f4c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f44f0b-f5') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG os_vif [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:03:17,bridge_name='br-int',has_traffic_filtering=True,id=27f44f0b-f5e3-4ba9-a320-c41109cb8f4c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f44f0b-f5') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27f44f0b-f5, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd16dfb6-2c65-4f5a-816a-bd48014b33ef) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:56:58 user nova-compute[75469]: INFO os_vif [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:03:17,bridge_name='br-int',has_traffic_filtering=True,id=27f44f0b-f5e3-4ba9-a320-c41109cb8f4c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f44f0b-f5')
Nov 14 04:56:58 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Deleting instance files /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5_del
Nov 14 04:56:58 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Deletion of /opt/stack/data/nova/instances/73091efc-4129-40a8-8d82-c852ac6fa0c5_del complete
Nov 14 04:56:58 user nova-compute[75469]: INFO nova.compute.manager [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 04:56:58 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-f5ad7d91-245d-4dcb-b981-d5566c6313e9 req-22978cce-b920-4a9e-8fb1-65a99b93dcbf service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Received event network-vif-unplugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f5ad7d91-245d-4dcb-b981-d5566c6313e9 req-22978cce-b920-4a9e-8fb1-65a99b93dcbf service nova] Acquiring lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f5ad7d91-245d-4dcb-b981-d5566c6313e9 req-22978cce-b920-4a9e-8fb1-65a99b93dcbf service nova] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f5ad7d91-245d-4dcb-b981-d5566c6313e9 req-22978cce-b920-4a9e-8fb1-65a99b93dcbf service nova] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-f5ad7d91-245d-4dcb-b981-d5566c6313e9 req-22978cce-b920-4a9e-8fb1-65a99b93dcbf service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] No waiting events found dispatching network-vif-unplugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:56:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-f5ad7d91-245d-4dcb-b981-d5566c6313e9 req-22978cce-b920-4a9e-8fb1-65a99b93dcbf service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Received event network-vif-unplugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:56:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:56:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:56:59 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:56:59 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Successfully updated port: bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:56:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:56:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquired lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:56:59 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:56:59 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Took 0.85 seconds to deallocate network for instance.
Nov 14 04:56:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:56:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:56:59 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.network.neutron [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updating instance_info_cache with network_info: [{"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Releasing lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Instance network_info: |[{"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Start _get_guest_xml network_info=[{"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:57:00 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:57:00 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-507385695',display_name='tempest-ServerStableDeviceRescueTest-server-507385695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-507385695',id=18,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1+oqJ9P3bJ6y3y5C3t27tL4Ym2PLlY6l+cjQK9mE7PE9A+RlQ7Gt4TEObvMcrKFh4CuugLIwEsNKlc182b2KNQ2YftDJe4jK9zJ+va2E7K+EFaHyRoGOtaoVfEeS4fzA==',key_name='tempest-keypair-1578813028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a019d303cd8c4aaca04142c29797192f',ramdisk_id='',reservation_id='r-q4c5sspw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-40224201',owner_user_name='tempest-ServerStableDeviceRescueTest-40224201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5082710327f40249242020afcfe1b62',uuid=c0ca77d2-8353-4dfc-beed-ac479535b5ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Converting VIF {"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ee:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf280bdb-b07e-4472-b87a-304b48127d7c,network=Network(2d30057a-3bb9-4010-befa-3f57b496f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf280bdb-b0') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.objects.instance [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'pci_devices' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:57:00 user nova-compute[75469]:   <uuid>c0ca77d2-8353-4dfc-beed-ac479535b5ba</uuid>
Nov 14 04:57:00 user nova-compute[75469]:   <name>instance-00000012</name>
Nov 14 04:57:00 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:57:00 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:57:00 user nova-compute[75469]:   <metadata>
Nov 14 04:57:00 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:57:00 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:57:00 user nova-compute[75469]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-507385695</nova:name>
Nov 14 04:57:00 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:57:00</nova:creationTime>
Nov 14 04:57:00 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:57:00 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:57:00 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:57:00 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:57:00 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:57:00 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:57:00 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:57:00 user nova-compute[75469]:       <nova:owner>
Nov 14 04:57:00 user nova-compute[75469]:         <nova:user uuid="b5082710327f40249242020afcfe1b62">tempest-ServerStableDeviceRescueTest-40224201-project-member</nova:user>
Nov 14 04:57:00 user nova-compute[75469]:         <nova:project uuid="a019d303cd8c4aaca04142c29797192f">tempest-ServerStableDeviceRescueTest-40224201</nova:project>
Nov 14 04:57:00 user nova-compute[75469]:       </nova:owner>
Nov 14 04:57:00 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:57:00 user nova-compute[75469]:       <nova:ports>
Nov 14 04:57:00 user nova-compute[75469]:         <nova:port uuid="bf280bdb-b07e-4472-b87a-304b48127d7c">
Nov 14 04:57:00 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 04:57:00 user nova-compute[75469]:         </nova:port>
Nov 14 04:57:00 user nova-compute[75469]:       </nova:ports>
Nov 14 04:57:00 user nova-compute[75469]:     </nova:instance>
Nov 14 04:57:00 user nova-compute[75469]:   </metadata>
Nov 14 04:57:00 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:57:00 user nova-compute[75469]:     <system>
Nov 14 04:57:00 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:57:00 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:57:00 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:57:00 user nova-compute[75469]:       <entry name="serial">c0ca77d2-8353-4dfc-beed-ac479535b5ba</entry>
Nov 14 04:57:00 user nova-compute[75469]:       <entry name="uuid">c0ca77d2-8353-4dfc-beed-ac479535b5ba</entry>
Nov 14 04:57:00 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:57:00 user nova-compute[75469]:     </system>
Nov 14 04:57:00 user nova-compute[75469]:   </sysinfo>
Nov 14 04:57:00 user nova-compute[75469]:   <os>
Nov 14 04:57:00 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:57:00 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:57:00 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:57:00 user nova-compute[75469]:   </os>
Nov 14 04:57:00 user nova-compute[75469]:   <features>
Nov 14 04:57:00 user nova-compute[75469]:     <acpi/>
Nov 14 04:57:00 user nova-compute[75469]:     <apic/>
Nov 14 04:57:00 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:57:00 user nova-compute[75469]:   </features>
Nov 14 04:57:00 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:57:00 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:57:00 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:57:00 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:57:00 user nova-compute[75469]:   </clock>
Nov 14 04:57:00 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:57:00 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:57:00 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:57:00 user nova-compute[75469]:   </cpu>
Nov 14 04:57:00 user nova-compute[75469]:   <devices>
Nov 14 04:57:00 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:57:00 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:57:00 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk"/>
Nov 14 04:57:00 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:57:00 user nova-compute[75469]:     </disk>
Nov 14 04:57:00 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:57:00 user nova-compute[75469]:       <mac address="fa:16:3e:a1:ee:ec"/>
Nov 14 04:57:00 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:57:00 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:57:00 user nova-compute[75469]:       <target dev="tapbf280bdb-b0"/>
Nov 14 04:57:00 user nova-compute[75469]:     </interface>
Nov 14 04:57:00 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:57:00 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/console.log" append="off"/>
Nov 14 04:57:00 user nova-compute[75469]:     </serial>
Nov 14 04:57:00 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:57:00 user nova-compute[75469]:     <video>
Nov 14 04:57:00 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:57:00 user nova-compute[75469]:     </video>
Nov 14 04:57:00 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:57:00 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:57:00 user nova-compute[75469]:     </rng>
Nov 14 04:57:00 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:57:00 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:57:00 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:57:00 user nova-compute[75469]:     </memballoon>
Nov 14 04:57:00 user nova-compute[75469]:   </devices>
Nov 14 04:57:00 user nova-compute[75469]: </domain>
Nov 14 04:57:00 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-507385695',display_name='tempest-ServerStableDeviceRescueTest-server-507385695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-507385695',id=18,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1+oqJ9P3bJ6y3y5C3t27tL4Ym2PLlY6l+cjQK9mE7PE9A+RlQ7Gt4TEObvMcrKFh4CuugLIwEsNKlc182b2KNQ2YftDJe4jK9zJ+va2E7K+EFaHyRoGOtaoVfEeS4fzA==',key_name='tempest-keypair-1578813028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a019d303cd8c4aaca04142c29797192f',ramdisk_id='',reservation_id='r-q4c5sspw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-40224201',owner_user_name='tempest-ServerStableDeviceRescueTest-40224201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5082710327f40249242020afcfe1b62',uuid=c0ca77d2-8353-4dfc-beed-ac479535b5ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Converting VIF {"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ee:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf280bdb-b07e-4472-b87a-304b48127d7c,network=Network(2d30057a-3bb9-4010-befa-3f57b496f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf280bdb-b0') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG os_vif [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ee:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf280bdb-b07e-4472-b87a-304b48127d7c,network=Network(2d30057a-3bb9-4010-befa-3f57b496f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf280bdb-b0') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dce4b5b-a8ad-5503-adff-ca0febd72f6e', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf280bdb-b0, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf280bdb-b0, col_values=(('qos', UUID('9a5f68b4-e0c4-42a4-8304-9239ca6f8855')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf280bdb-b0, col_values=(('external_ids', {'iface-id': 'bf280bdb-b07e-4472-b87a-304b48127d7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:ee:ec', 'vm-uuid': 'c0ca77d2-8353-4dfc-beed-ac479535b5ba'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:00 user nova-compute[75469]: INFO os_vif [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ee:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf280bdb-b07e-4472-b87a-304b48127d7c,network=Network(2d30057a-3bb9-4010-befa-3f57b496f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf280bdb-b0')
Nov 14 04:57:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:57:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] No VIF found with MAC fa:16:3e:a1:ee:ec, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:57:00 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Deleted allocations for instance 73091efc-4129-40a8-8d82-c852ac6fa0c5
Nov 14 04:57:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-62b3b48a-d4b4-4f6c-8b26-41cb82aa43dc tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.718s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Received event network-vif-plugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] Acquiring lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] Lock "73091efc-4129-40a8-8d82-c852ac6fa0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] No waiting events found dispatching network-vif-plugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:57:01 user nova-compute[75469]: WARNING nova.compute.manager [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Received unexpected event network-vif-plugged-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c for instance with vm_state deleted and task_state None.
Nov 14 04:57:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] [instance: 73091efc-4129-40a8-8d82-c852ac6fa0c5] Received event network-vif-deleted-27f44f0b-f5e3-4ba9-a320-c41109cb8f4c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-changed-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Refreshing instance network info cache due to event network-changed-bf280bdb-b07e-4472-b87a-304b48127d7c. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] Acquiring lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] Acquired lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG nova.network.neutron [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Refreshing network info cache for port bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG nova.network.neutron [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updated VIF entry in instance network info cache for port bf280bdb-b07e-4472-b87a-304b48127d7c. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG nova.network.neutron [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updating instance_info_cache with network_info: [{"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ad5a0df0-9fbc-4512-a2eb-0fd6ecee0e0f req-67bc7e06-8a63-4320-96bf-d0761b201e49 service nova] Releasing lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-c7ae4be8-69b5-4277-b141-b750812b70f7 req-a79a7699-15fc-4227-ae1b-94fb2f317cf0 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c7ae4be8-69b5-4277-b141-b750812b70f7 req-a79a7699-15fc-4227-ae1b-94fb2f317cf0 service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c7ae4be8-69b5-4277-b141-b750812b70f7 req-a79a7699-15fc-4227-ae1b-94fb2f317cf0 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c7ae4be8-69b5-4277-b141-b750812b70f7 req-a79a7699-15fc-4227-ae1b-94fb2f317cf0 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-c7ae4be8-69b5-4277-b141-b750812b70f7 req-a79a7699-15fc-4227-ae1b-94fb2f317cf0 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:57:02 user nova-compute[75469]: WARNING nova.compute.manager [req-c7ae4be8-69b5-4277-b141-b750812b70f7 req-a79a7699-15fc-4227-ae1b-94fb2f317cf0 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received unexpected event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with vm_state building and task_state spawning.
Nov 14 04:57:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-9b3e7350-22d4-4685-b3f8-b0ac67252095 req-c44cbc64-e1e0-4efb-a0cc-6835cc030888 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b3e7350-22d4-4685-b3f8-b0ac67252095 req-c44cbc64-e1e0-4efb-a0cc-6835cc030888 service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b3e7350-22d4-4685-b3f8-b0ac67252095 req-c44cbc64-e1e0-4efb-a0cc-6835cc030888 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9b3e7350-22d4-4685-b3f8-b0ac67252095 req-c44cbc64-e1e0-4efb-a0cc-6835cc030888 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-9b3e7350-22d4-4685-b3f8-b0ac67252095 req-c44cbc64-e1e0-4efb-a0cc-6835cc030888 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:57:04 user nova-compute[75469]: WARNING nova.compute.manager [req-9b3e7350-22d4-4685-b3f8-b0ac67252095 req-c44cbc64-e1e0-4efb-a0cc-6835cc030888 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received unexpected event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with vm_state building and task_state spawning.
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:57:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Instance spawned successfully.
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:57:04 user nova-compute[75469]: INFO nova.compute.manager [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Took 8.09 seconds to spawn the instance on the hypervisor.
Nov 14 04:57:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:57:04 user nova-compute[75469]: INFO nova.compute.manager [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Took 9.28 seconds to build instance.
Nov 14 04:57:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2a02337d-6a9f-4957-a740-2f6ebff1d873 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.416s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:33 user nova-compute[75469]: INFO nova.compute.manager [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Detaching volume d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1
Nov 14 04:57:33 user nova-compute[75469]: INFO nova.virt.block_device [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Attempting to driver detach volume d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 from mountpoint /dev/vdc
Nov 14 04:57:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Attempting to detach device vdc from instance fbbae8e3-5d56-41ed-9be2-8856c3420f44 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:57:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:57:33 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:57:33 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 04:57:33 user nova-compute[75469]:   <target dev="vdc" bus="virtio"/>
Nov 14 04:57:33 user nova-compute[75469]:   <serial>d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1</serial>
Nov 14 04:57:33 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 04:57:33 user nova-compute[75469]: </disk>
Nov 14 04:57:33 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:57:33 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Successfully detached device vdc from instance fbbae8e3-5d56-41ed-9be2-8856c3420f44 from the persistent domain config.
Nov 14 04:57:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fbbae8e3-5d56-41ed-9be2-8856c3420f44 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:57:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:57:33 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:57:33 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 04:57:33 user nova-compute[75469]:   <target dev="vdc" bus="virtio"/>
Nov 14 04:57:33 user nova-compute[75469]:   <serial>d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1</serial>
Nov 14 04:57:33 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 04:57:33 user nova-compute[75469]: </disk>
Nov 14 04:57:33 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:57:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:57:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:36 user nova-compute[75469]: INFO nova.compute.manager [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Detaching volume a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:57:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:36 user nova-compute[75469]: INFO nova.virt.block_device [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Attempting to driver detach volume a0c5f86b-996a-4683-90a1-2da62e9d51f4 from mountpoint /dev/vdb
Nov 14 04:57:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Attempting to detach device vdb from instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:57:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:57:36 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:57:36 user nova-compute[75469]:   <source dev="/dev/sdd"/>
Nov 14 04:57:36 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:57:36 user nova-compute[75469]:   <serial>a0c5f86b-996a-4683-90a1-2da62e9d51f4</serial>
Nov 14 04:57:36 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 04:57:36 user nova-compute[75469]: </disk>
Nov 14 04:57:36 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:57:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully detached device vdb from instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a from the persistent domain config.
Nov 14 04:57:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:57:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:57:36 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:57:36 user nova-compute[75469]:   <source dev="/dev/sdd"/>
Nov 14 04:57:36 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:57:36 user nova-compute[75469]:   <serial>a0c5f86b-996a-4683-90a1-2da62e9d51f4</serial>
Nov 14 04:57:36 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 04:57:36 user nova-compute[75469]: </disk>
Nov 14 04:57:36 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:57:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Port 45923d58-4176-482f-b9c0-6f871c90529c binding to destination host user is already ACTIVE {{(pid=75469) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquired lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating instance_info_cache with network_info: [{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Releasing lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Creating tmpfile /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/tmpnhujflo0 to verify with other compute node that the instance is on the same shared storage. {{(pid=75469) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-3746731c-a920-402f-b5c5-a6d54b8850ad req-0a1ff83e-4590-462d-94eb-5530d4df4f20 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3746731c-a920-402f-b5c5-a6d54b8850ad req-0a1ff83e-4590-462d-94eb-5530d4df4f20 service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3746731c-a920-402f-b5c5-a6d54b8850ad req-0a1ff83e-4590-462d-94eb-5530d4df4f20 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3746731c-a920-402f-b5c5-a6d54b8850ad req-0a1ff83e-4590-462d-94eb-5530d4df4f20 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-3746731c-a920-402f-b5c5-a6d54b8850ad req-0a1ff83e-4590-462d-94eb-5530d4df4f20 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:57:38 user nova-compute[75469]: WARNING nova.compute.manager [req-3746731c-a920-402f-b5c5-a6d54b8850ad req-0a1ff83e-4590-462d-94eb-5530d4df4f20 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state resized and task_state resize_reverting.
Nov 14 04:57:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance destroyed successfully.
Nov 14 04:57:39 user nova-compute[75469]: DEBUG nova.objects.instance [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lazy-loading 'resources' on Instance uuid fb551839-7b5a-4ecd-b9c0-ab53addeaa45 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-501716171',display_name='tempest-ServerActionsTestOtherB-server-501716171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-501716171',id=4,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCM9hFVe3wxoADlpmZS5pvsZqPL5+bIs5VB/4pYIHPJU3LZ6fFGC+bLXtjhSZVFtu7N4xdCrGz0UJgg9Kot0QzE0EwlPJEFb1NBTvEvGy/Q0Twm7zNyBzgTNIwdP75tUg==',key_name='tempest-keypair-1630737506',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a921fed4277644dd9b75295d99c4af6b',ramdisk_id='',reservation_id='r-4b5895c5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1992991016',owner_user_name='tempest-ServerActionsTestOtherB-1992991016-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c089065dec4fbdaf39807c43265ecf',uuid=fb551839-7b5a-4ecd-b9c0-ab53addeaa45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converting VIF {"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_vif [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45923d58-41, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47e36dd0-931a-483e-aa0c-98c7dbb9e376) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:39 user nova-compute[75469]: INFO os_vif [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41')
Nov 14 04:57:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knptGdZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:57:39 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2188fb15-5218-455f-8fd3-dbe33c2b8847]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:57:39 user nova-compute[75469]: No targets found.
Nov 14 04:57:39 user nova-compute[75469]: iSNS:
Nov 14 04:57:39 user nova-compute[75469]: No targets found.
Nov 14 04:57:39 user nova-compute[75469]: STATIC:
Nov 14 04:57:39 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188
Nov 14 04:57:39 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:57:39 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:57:39 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:57:39 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:57:39 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:57:39 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 04:57:39 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:57:39 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:57:39 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1
Nov 14 04:57:39 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:57:39 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:57:39 user nova-compute[75469]: FIRMWARE:
Nov 14 04:57:39 user nova-compute[75469]: No targets found.
Nov 14 04:57:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:57:39 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:57:39 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c73ef4-a6f0-461f-a38a-507519854941]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b957f98-9191-4e35-b43f-adb7ba24cddf]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:57:39 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:57:39 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:57:39 user nova-compute[75469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:57:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:57:39 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:57:39 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:57:39 user nova-compute[75469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:57:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f5ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188'): ({'sde'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Removing single pathed devices sde {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fce15f-8346-41e2-aa4c-ee986d211401]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6f77a7-f43d-486d-9b57-1a25fa419c74]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Flushing IO for device /dev/sde {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88320ef-9134-46ec-a40a-1123d9725bda]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[31228cec-7297-4f80-906f-7a7d43f12270]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e43b9f-e27c-45fe-9e86-a7c0059c04e9]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7321df-7bca-436f-b9bb-d17e3110de75]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]
Nov 14 04:57:39 user nova-compute[75469]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.
Nov 14 04:57:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4410a8-b32a-4b7f-8a17-c956f95925e6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] <== disconnect_volume: return (330ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:57:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:57:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:40 user nova-compute[75469]: DEBUG nova.objects.instance [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lazy-loading 'migration_context' on Instance uuid fb551839-7b5a-4ecd-b9c0-ab53addeaa45 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:57:40 user nova-compute[75469]: DEBUG nova.objects.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Object Instance<fb551839-7b5a-4ecd-b9c0-ab53addeaa45> lazy-loaded attributes: resources,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:57:40 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:57:40 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:57:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-637f44b7-b541-4627-828b-6521bb09081b req-581a57cf-4db4-4cda-b8f7-335c73ed40a5 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-637f44b7-b541-4627-828b-6521bb09081b req-581a57cf-4db4-4cda-b8f7-335c73ed40a5 service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-637f44b7-b541-4627-828b-6521bb09081b req-581a57cf-4db4-4cda-b8f7-335c73ed40a5 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-637f44b7-b541-4627-828b-6521bb09081b req-581a57cf-4db4-4cda-b8f7-335c73ed40a5 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-637f44b7-b541-4627-828b-6521bb09081b req-581a57cf-4db4-4cda-b8f7-335c73ed40a5 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:57:41 user nova-compute[75469]: WARNING nova.compute.manager [req-637f44b7-b541-4627-828b-6521bb09081b req-581a57cf-4db4-4cda-b8f7-335c73ed40a5 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state resized and task_state resize_reverting.
Nov 14 04:57:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.472s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:41 user nova-compute[75469]: INFO nova.compute.manager [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Swapping old allocation on dict_keys(['96d8ab03-209c-478b-97a4-3b20ae4d0ee4']) held by migration e209f1ff-4fff-46a3-8c86-bd11e783e5d2 for instance
Nov 14 04:57:41 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Overwriting current allocation {'allocations': {'96d8ab03-209c-478b-97a4-3b20ae4d0ee4': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': 'a921fed4277644dd9b75295d99c4af6b', 'user_id': '73c089065dec4fbdaf39807c43265ecf', 'consumer_generation': 1} on consumer fb551839-7b5a-4ecd-b9c0-ab53addeaa45 {{(pid=75469) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 04:57:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:57:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquired lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:57:41 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating instance_info_cache with network_info: [{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Releasing lock "refresh_cache-fb551839-7b5a-4ecd-b9c0-ab53addeaa45" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG os_brick.utils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8084933-2703-4a6f-902b-a891035e7e67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9416db69-5138-43d6-8076-903e9ce4afe0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3ed9b0-d421-49d0-b885-6d3a535840ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[010b2e58-4151-4c8e-ad3c-925248655c9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:57:42 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:57:42 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde03d3-e446-44d1-bce9-dfe4c3beb606]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:57:42 user nova-compute[75469]: DEBUG os_brick.utils [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:57:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Starting finish_revert_migration {{(pid=75469) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Start _get_guest_xml network_info=[{"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '0dd21e23-ed10-4439-8aa3-3d0cf0d910d5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knptGdZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'fb551839-7b5a-4ecd-b9c0-ab53addeaa45', 'attached_at': '2023-11-14T04:57:46.000000', 'detached_at': '', 'volume_id': '3fc11541-4c2d-4184-bee8-29391718e188', 'serial': '3fc11541-4c2d-4184-bee8-29391718e188'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:57:46 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:57:46 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.objects.instance [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb551839-7b5a-4ecd-b9c0-ab53addeaa45 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knptGdZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:57:46 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:57:46 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:57:46 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e7878-f300-44c1-a9eb-568095a031af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:57:46 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e71fb9-421f-47c1-80fd-af272fc287b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188] added
Nov 14 04:57:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7aa66f-2141-40c9-83ca-a9e45d294966]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Updating instance_info_cache with network_info: [{"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c59ee1d-2f38-40b3-a539-3f2870ac9f71]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knptGdZo {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-0faef65d-62e0-4d48-92d5-f50395b7d190" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knptGdZo" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae446781-c033-4720-bb4c-ac84112a3fad]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'knptGdZo'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1c3d61-704d-4ef4-9eed-7c9c319c599b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c00a192-70f4-48ee-a91e-fbc64c96637a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[407f3e34-84d6-4247-87d8-338cce35ce95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]
Nov 14 04:57:46 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.
Nov 14 04:57:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2062bf61-aa7f-4900-ac2c-e3d6e06ed429]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7bca09-2b3a-4993-96ef-deb8f413b4fe]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:57:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5cd498-f9be-4f78-972d-d12150712045]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:57:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knptGdZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23466663565613362', 'path': '/dev/sde'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466663565613362', 'path': '/dev/sde'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-501716171',display_name='tempest-ServerActionsTestOtherB-server-501716171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-501716171',id=4,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCM9hFVe3wxoADlpmZS5pvsZqPL5+bIs5VB/4pYIHPJU3LZ6fFGC+bLXtjhSZVFtu7N4xdCrGz0UJgg9Kot0QzE0EwlPJEFb1NBTvEvGy/Q0Twm7zNyBzgTNIwdP75tUg==',key_name='tempest-keypair-1630737506',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a921fed4277644dd9b75295d99c4af6b',ramdisk_id='',reservation_id='r-4b5895c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1992991016',owner_user_name='tempest-ServerActionsTestOtherB-1992991016-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c089065dec4fbdaf39807c43265ecf',uuid=fb551839-7b5a-4ecd-b9c0-ab53addeaa45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converting VIF {"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:57:48 user nova-compute[75469]:   <uuid>fb551839-7b5a-4ecd-b9c0-ab53addeaa45</uuid>
Nov 14 04:57:48 user nova-compute[75469]:   <name>instance-00000004</name>
Nov 14 04:57:48 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:57:48 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:57:48 user nova-compute[75469]:   <metadata>
Nov 14 04:57:48 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:57:48 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:57:48 user nova-compute[75469]:       <nova:name>tempest-ServerActionsTestOtherB-server-501716171</nova:name>
Nov 14 04:57:48 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:57:46</nova:creationTime>
Nov 14 04:57:48 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:57:48 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:57:48 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:57:48 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:57:48 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:57:48 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:57:48 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:57:48 user nova-compute[75469]:       <nova:owner>
Nov 14 04:57:48 user nova-compute[75469]:         <nova:user uuid="73c089065dec4fbdaf39807c43265ecf">tempest-ServerActionsTestOtherB-1992991016-project-member</nova:user>
Nov 14 04:57:48 user nova-compute[75469]:         <nova:project uuid="a921fed4277644dd9b75295d99c4af6b">tempest-ServerActionsTestOtherB-1992991016</nova:project>
Nov 14 04:57:48 user nova-compute[75469]:       </nova:owner>
Nov 14 04:57:48 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:57:48 user nova-compute[75469]:       <nova:ports>
Nov 14 04:57:48 user nova-compute[75469]:         <nova:port uuid="45923d58-4176-482f-b9c0-6f871c90529c">
Nov 14 04:57:48 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 04:57:48 user nova-compute[75469]:         </nova:port>
Nov 14 04:57:48 user nova-compute[75469]:       </nova:ports>
Nov 14 04:57:48 user nova-compute[75469]:     </nova:instance>
Nov 14 04:57:48 user nova-compute[75469]:   </metadata>
Nov 14 04:57:48 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:57:48 user nova-compute[75469]:     <system>
Nov 14 04:57:48 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:57:48 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:57:48 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:57:48 user nova-compute[75469]:       <entry name="serial">fb551839-7b5a-4ecd-b9c0-ab53addeaa45</entry>
Nov 14 04:57:48 user nova-compute[75469]:       <entry name="uuid">fb551839-7b5a-4ecd-b9c0-ab53addeaa45</entry>
Nov 14 04:57:48 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:57:48 user nova-compute[75469]:     </system>
Nov 14 04:57:48 user nova-compute[75469]:   </sysinfo>
Nov 14 04:57:48 user nova-compute[75469]:   <os>
Nov 14 04:57:48 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:57:48 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:57:48 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:57:48 user nova-compute[75469]:   </os>
Nov 14 04:57:48 user nova-compute[75469]:   <features>
Nov 14 04:57:48 user nova-compute[75469]:     <acpi/>
Nov 14 04:57:48 user nova-compute[75469]:     <apic/>
Nov 14 04:57:48 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:57:48 user nova-compute[75469]:   </features>
Nov 14 04:57:48 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:57:48 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:57:48 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:57:48 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:57:48 user nova-compute[75469]:   </clock>
Nov 14 04:57:48 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:57:48 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:57:48 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:57:48 user nova-compute[75469]:   </cpu>
Nov 14 04:57:48 user nova-compute[75469]:   <devices>
Nov 14 04:57:48 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:57:48 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:57:48 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk"/>
Nov 14 04:57:48 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:57:48 user nova-compute[75469]:     </disk>
Nov 14 04:57:48 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:57:48 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:57:48 user nova-compute[75469]:       <source dev="/dev/sde"/>
Nov 14 04:57:48 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 04:57:48 user nova-compute[75469]:       <serial>3fc11541-4c2d-4184-bee8-29391718e188</serial>
Nov 14 04:57:48 user nova-compute[75469]:     </disk>
Nov 14 04:57:48 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:57:48 user nova-compute[75469]:       <mac address="fa:16:3e:44:d1:3e"/>
Nov 14 04:57:48 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:57:48 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:57:48 user nova-compute[75469]:       <target dev="tap45923d58-41"/>
Nov 14 04:57:48 user nova-compute[75469]:     </interface>
Nov 14 04:57:48 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:57:48 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/console.log" append="off"/>
Nov 14 04:57:48 user nova-compute[75469]:     </serial>
Nov 14 04:57:48 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:57:48 user nova-compute[75469]:     <video>
Nov 14 04:57:48 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:57:48 user nova-compute[75469]:     </video>
Nov 14 04:57:48 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:57:48 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:57:48 user nova-compute[75469]:     </rng>
Nov 14 04:57:48 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:57:48 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:57:48 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:57:48 user nova-compute[75469]:     </memballoon>
Nov 14 04:57:48 user nova-compute[75469]:   </devices>
Nov 14 04:57:48 user nova-compute[75469]: </domain>
Nov 14 04:57:48 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-501716171',display_name='tempest-ServerActionsTestOtherB-server-501716171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-501716171',id=4,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCM9hFVe3wxoADlpmZS5pvsZqPL5+bIs5VB/4pYIHPJU3LZ6fFGC+bLXtjhSZVFtu7N4xdCrGz0UJgg9Kot0QzE0EwlPJEFb1NBTvEvGy/Q0Twm7zNyBzgTNIwdP75tUg==',key_name='tempest-keypair-1630737506',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a921fed4277644dd9b75295d99c4af6b',ramdisk_id='',reservation_id='r-4b5895c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1992991016',owner_user_name='tempest-ServerActionsTestOtherB-1992991016-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c089065dec4fbdaf39807c43265ecf',uuid=fb551839-7b5a-4ecd-b9c0-ab53addeaa45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converting VIF {"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG os_vif [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ae442ef-a2b1-5c06-9bdc-f76ae96c415f', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45923d58-41, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45923d58-41, col_values=(('qos', UUID('b3c3fd3f-e70d-4a64-98d2-0e6ab5342303')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45923d58-41, col_values=(('external_ids', {'iface-id': '45923d58-4176-482f-b9c0-6f871c90529c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:d1:3e', 'vm-uuid': 'fb551839-7b5a-4ecd-b9c0-ab53addeaa45'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:48 user nova-compute[75469]: INFO os_vif [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41')
Nov 14 04:57:48 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-35886b9d-4e28-4b92-b449-667ce07e069e req-117649db-e624-42b2-8215-a1f4d0062c53 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-35886b9d-4e28-4b92-b449-667ce07e069e req-117649db-e624-42b2-8215-a1f4d0062c53 service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-35886b9d-4e28-4b92-b449-667ce07e069e req-117649db-e624-42b2-8215-a1f4d0062c53 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-35886b9d-4e28-4b92-b449-667ce07e069e req-117649db-e624-42b2-8215-a1f4d0062c53 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-35886b9d-4e28-4b92-b449-667ce07e069e req-117649db-e624-42b2-8215-a1f4d0062c53 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:57:49 user nova-compute[75469]: WARNING nova.compute.manager [req-35886b9d-4e28-4b92-b449-667ce07e069e req-117649db-e624-42b2-8215-a1f4d0062c53 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state resized and task_state resize_reverting.
Nov 14 04:57:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "0faef65d-62e0-4d48-92d5-f50395b7d190" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:51 user nova-compute[75469]: INFO nova.compute.manager [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Terminating instance
Nov 14 04:57:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-c99afb84-c26f-46c1-9c7f-a885a9a95f2b req-d3559e60-b988-4ca1-ac68-5f6a5bf7c5d9 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c99afb84-c26f-46c1-9c7f-a885a9a95f2b req-d3559e60-b988-4ca1-ac68-5f6a5bf7c5d9 service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c99afb84-c26f-46c1-9c7f-a885a9a95f2b req-d3559e60-b988-4ca1-ac68-5f6a5bf7c5d9 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c99afb84-c26f-46c1-9c7f-a885a9a95f2b req-d3559e60-b988-4ca1-ac68-5f6a5bf7c5d9 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-c99afb84-c26f-46c1-9c7f-a885a9a95f2b req-d3559e60-b988-4ca1-ac68-5f6a5bf7c5d9 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:57:51 user nova-compute[75469]: WARNING nova.compute.manager [req-c99afb84-c26f-46c1-9c7f-a885a9a95f2b req-d3559e60-b988-4ca1-ac68-5f6a5bf7c5d9 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state resized and task_state resize_reverting.
Nov 14 04:57:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:57:51 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance running successfully.
Nov 14 04:57:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] finish_revert_migration finished successfully. {{(pid=75469) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 04:57:51 user nova-compute[75469]: INFO nova.compute.manager [None req-9d93a3d7-51e9-4884-b067-c3354e1ff2d4 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating instance to original state: 'active'
Nov 14 04:57:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-71fca000-46d2-4c31-baf6-cb2d558f9c7e req-257727b3-0c55-4c5c-8805-3b67b411ce59 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Received event network-vif-unplugged-9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-71fca000-46d2-4c31-baf6-cb2d558f9c7e req-257727b3-0c55-4c5c-8805-3b67b411ce59 service nova] Acquiring lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-71fca000-46d2-4c31-baf6-cb2d558f9c7e req-257727b3-0c55-4c5c-8805-3b67b411ce59 service nova] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-71fca000-46d2-4c31-baf6-cb2d558f9c7e req-257727b3-0c55-4c5c-8805-3b67b411ce59 service nova] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-71fca000-46d2-4c31-baf6-cb2d558f9c7e req-257727b3-0c55-4c5c-8805-3b67b411ce59 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] No waiting events found dispatching network-vif-unplugged-9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-71fca000-46d2-4c31-baf6-cb2d558f9c7e req-257727b3-0c55-4c5c-8805-3b67b411ce59 service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Received event network-vif-unplugged-9c3ca113-2c42-477e-9a19-7e00ef90718c for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:57:52 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Instance destroyed successfully.
Nov 14 04:57:52 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lazy-loading 'resources' on Instance uuid 0faef65d-62e0-4d48-92d5-f50395b7d190 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-840621284',display_name='tempest-VolumesAdminNegativeTest-server-840621284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-840621284',id=6,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtdodjnzuuNxBy5CZAVNizX3irMrNo0a7oAD2sDIxmD18ymMcjDTrZtYn5hER1EQ6w9kRQtU410cnBB7rZJktdTMNW0ELNj4PMUveuXafBBiHl4pQSBV33pu3oQHWwP2Q==',key_name='tempest-keypair-505199733',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94c2c1e6fdb7497aab43cd768f8ea236',ramdisk_id='',reservation_id='r-l5xr0y8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1455966896',owner_user_name='tempest-VolumesAdminNegativeTest-1455966896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:52:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb5695c4e5d74c269678220aa4e1b9bf',uuid=0faef65d-62e0-4d48-92d5-f50395b7d190,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converting VIF {"id": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "address": "fa:16:3e:73:31:86", "network": {"id": "3dcd6dd3-8748-44e9-bedf-02851143f1bb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1780876393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2c1e6fdb7497aab43cd768f8ea236", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3ca113-2c", "ovs_interfaceid": "9c3ca113-2c42-477e-9a19-7e00ef90718c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:31:86,bridge_name='br-int',has_traffic_filtering=True,id=9c3ca113-2c42-477e-9a19-7e00ef90718c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3ca113-2c') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG os_vif [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:31:86,bridge_name='br-int',has_traffic_filtering=True,id=9c3ca113-2c42-477e-9a19-7e00ef90718c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3ca113-2c') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c3ca113-2c, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6aabdd33-472b-45c8-b96c-605043936357) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:52 user nova-compute[75469]: INFO os_vif [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:31:86,bridge_name='br-int',has_traffic_filtering=True,id=9c3ca113-2c42-477e-9a19-7e00ef90718c,network=Network(3dcd6dd3-8748-44e9-bedf-02851143f1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3ca113-2c')
Nov 14 04:57:52 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Deleting instance files /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190_del
Nov 14 04:57:52 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Deletion of /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190_del complete
Nov 14 04:57:52 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000006, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/0faef65d-62e0-4d48-92d5-f50395b7d190/disk
Nov 14 04:57:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:52 user nova-compute[75469]: INFO nova.compute.manager [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 14 04:57:52 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-b09cb3be-a143-49ad-8725-d71b58fcf2b7 req-2bb69f76-fa27-4507-aa6b-7597f40f0436 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-changed-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-b09cb3be-a143-49ad-8725-d71b58fcf2b7 req-2bb69f76-fa27-4507-aa6b-7597f40f0436 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Refreshing instance network info cache due to event network-changed-ae16d917-f1e7-40f3-86cf-ea7150673ddb. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b09cb3be-a143-49ad-8725-d71b58fcf2b7 req-2bb69f76-fa27-4507-aa6b-7597f40f0436 service nova] Acquiring lock "refresh_cache-61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b09cb3be-a143-49ad-8725-d71b58fcf2b7 req-2bb69f76-fa27-4507-aa6b-7597f40f0436 service nova] Acquired lock "refresh_cache-61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG nova.network.neutron [req-b09cb3be-a143-49ad-8725-d71b58fcf2b7 req-2bb69f76-fa27-4507-aa6b-7597f40f0436 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Refreshing network info cache for port ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:57:53 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Took 1.43 seconds to deallocate network for instance.
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:54 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance fbbae8e3-5d56-41ed-9be2-8856c3420f44 is timed out.
Nov 14 04:57:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Successfully detached device vdc from instance fbbae8e3-5d56-41ed-9be2-8856c3420f44 from the live domain config.
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRPvHJdW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:57:54 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.network.neutron [req-b09cb3be-a143-49ad-8725-d71b58fcf2b7 req-2bb69f76-fa27-4507-aa6b-7597f40f0436 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Updated VIF entry in instance network info cache for port ae16d917-f1e7-40f3-86cf-ea7150673ddb. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.network.neutron [req-b09cb3be-a143-49ad-8725-d71b58fcf2b7 req-2bb69f76-fa27-4507-aa6b-7597f40f0436 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Updating instance_info_cache with network_info: [{"id": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "address": "fa:16:3e:a3:b1:4e", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae16d917-f1", "ovs_interfaceid": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e245e36b-ad7d-4930-8168-aa4fc201ba9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-314d4438-14a0-418e-8b28-54a254e58b9c req-51b3a8e8-7b36-4ec0-b2ae-2ce76897939f service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Received event network-vif-plugged-9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-314d4438-14a0-418e-8b28-54a254e58b9c req-51b3a8e8-7b36-4ec0-b2ae-2ce76897939f service nova] Acquiring lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-314d4438-14a0-418e-8b28-54a254e58b9c req-51b3a8e8-7b36-4ec0-b2ae-2ce76897939f service nova] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-314d4438-14a0-418e-8b28-54a254e58b9c req-51b3a8e8-7b36-4ec0-b2ae-2ce76897939f service nova] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-314d4438-14a0-418e-8b28-54a254e58b9c req-51b3a8e8-7b36-4ec0-b2ae-2ce76897939f service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] No waiting events found dispatching network-vif-plugged-9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:57:54 user nova-compute[75469]: WARNING nova.compute.manager [req-314d4438-14a0-418e-8b28-54a254e58b9c req-51b3a8e8-7b36-4ec0-b2ae-2ce76897939f service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Received unexpected event network-vif-plugged-9c3ca113-2c42-477e-9a19-7e00ef90718c for instance with vm_state deleted and task_state None.
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-314d4438-14a0-418e-8b28-54a254e58b9c req-51b3a8e8-7b36-4ec0-b2ae-2ce76897939f service nova] [instance: 0faef65d-62e0-4d48-92d5-f50395b7d190] Received event network-vif-deleted-9c3ca113-2c42-477e-9a19-7e00ef90718c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b09cb3be-a143-49ad-8725-d71b58fcf2b7 req-2bb69f76-fa27-4507-aa6b-7597f40f0436 service nova] Releasing lock "refresh_cache-61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:57:54 user nova-compute[75469]: No targets found.
Nov 14 04:57:54 user nova-compute[75469]: iSNS:
Nov 14 04:57:54 user nova-compute[75469]: No targets found.
Nov 14 04:57:54 user nova-compute[75469]: STATIC:
Nov 14 04:57:54 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188
Nov 14 04:57:54 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:57:54 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:57:54 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:57:54 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:57:54 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:57:54 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 04:57:54 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:57:54 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:57:54 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1
Nov 14 04:57:54 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:57:54 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:57:54 user nova-compute[75469]: FIRMWARE:
Nov 14 04:57:54 user nova-compute[75469]: No targets found.
Nov 14 04:57:54 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:57:54 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:57:54 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8c7c8e-b8da-4ba4-9f84-da0e49c23d69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[424aa1cb-9bc1-47b4-ae2a-be3503d13fe7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:57:54 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:57:54 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:57:54 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:57:54 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:57:54 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:57:54 user nova-compute[75469]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 (non-flash)
Nov 14 04:57:54 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:57:54 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c3d7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[04137336-4880-40e3-9d55-54f32bb57d1d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4607d503-edbc-4a6f-9eb2-1c5c9b921baf]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd88d04-0ef6-41c9-b6c7-177b3b0200b3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee600db3-0526-43c5-932a-a4bc5aa144a7]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1d9c77-c9f8-4a83-88f9-c7ec0694ac88]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[082b87ab-2225-4ee3-beca-fae1448bb7ff]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1, portal: 172.16.0.220,3260]
Nov 14 04:57:54 user nova-compute[75469]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1, portal: 172.16.0.220,3260] successful.
Nov 14 04:57:54 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4a5e0c1-b9ca-4833-832a-b14ca1cfa7b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a7e472-87de-4b3e-9908-7c0601c2458e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] <== disconnect_volume: return (439ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.objects.instance [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'flavor' on Instance uuid 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:54 user nova-compute[75469]: INFO nova.compute.manager [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Attaching volume a43a992e-b094-4204-9025-17f075f217ef to /dev/vdb
Nov 14 04:57:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:57:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.063s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:55 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Deleted allocations for instance 0faef65d-62e0-4d48-92d5-f50395b7d190
Nov 14 04:57:55 user nova-compute[75469]: DEBUG os_brick.utils [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bb8248-e04a-40a5-bd88-ef98db016e03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[546cff65-5a70-4b7b-a638-7e282f0e826b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e663c562-ad4b-457b-afd8-196286ddf0c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f30dac5-faf7-4826-bb18-b01fb4c05db2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ca5ee21-4a19-480b-927b-5a393ed71ca9 tempest-VolumesAdminNegativeTest-1455966896 tempest-VolumesAdminNegativeTest-1455966896-project-member] Lock "0faef65d-62e0-4d48-92d5-f50395b7d190" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.851s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:57:55 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b71d34-719a-4b62-8b01-cf8f02f84c40]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG os_brick.utils [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Updating existing volume attachment record: 0bf858f0-3f34-4388-8c9f-1c1df13420c1 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG nova.objects.instance [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'flavor' on Instance uuid fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-465665a0-953e-453f-851f-70ff0f65dd74 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.149s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a is timed out.
Nov 14 04:57:56 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully detached device vdb from instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a from the live domain config.
Nov 14 04:57:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:57:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7373MB free_disk=25.122196197509766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIhwqitL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:57:56 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[163f7934-ce85-4450-a0af-64dfd10cdd6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:57:56 user nova-compute[75469]: No targets found.
Nov 14 04:57:56 user nova-compute[75469]: iSNS:
Nov 14 04:57:56 user nova-compute[75469]: No targets found.
Nov 14 04:57:56 user nova-compute[75469]: STATIC:
Nov 14 04:57:56 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188
Nov 14 04:57:56 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:57:56 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:57:56 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4
Nov 14 04:57:56 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:57:56 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:57:56 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 04:57:56 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:57:56 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:57:56 user nova-compute[75469]: FIRMWARE:
Nov 14 04:57:56 user nova-compute[75469]: No targets found.
Nov 14 04:57:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:57:56 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:57:56 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[df525f4d-cc4d-4b74-8039-1ee6e7e91cc0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd957cc-ab52-4b0f-b716-c80bfd60675c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:57:56 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:57:56 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:57:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:57:56 user nova-compute[75469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 (non-flash)
Nov 14 04:57:56 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:57:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c282200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4'): ({'sdd'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Removing single pathed devices sdd {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b75f629-3b59-4094-b436-0347a856e417]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fbbae8e3-5d56-41ed-9be2-8856c3420f44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fb551839-7b5a-4ecd-b9c0-ab53addeaa45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 5c7280e0-6117-48b8-8406-276edcc2051c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c0ca77d2-8353-4dfc-beed-ac479535b5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a5a350-1349-45c7-980f-4637bb8b59ed]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flushing IO for device /dev/sdd {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[98880799-3846-4b66-aa94-cd60e449d310]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7658309d-deca-4691-b600-2e318ac9328d]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fe4634-6bc8-435c-8abb-50990cdefb7d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9b1e4c-e59b-4ec3-ac66-65c128a04bb5]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260]
Nov 14 04:57:56 user nova-compute[75469]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4, portal: 172.16.0.220,3260] successful.
Nov 14 04:57:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0c5f86b-996a-4683-90a1-2da62e9d51f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[998d4bb2-7b93-4027-ac7d-d68fb76c86ed]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] <== disconnect_volume: return (338ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:57:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:57:57 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:57:57 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:57:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:57:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:57 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:57:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 04:57:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 04:57:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:57 user nova-compute[75469]: DEBUG nova.objects.instance [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:57:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-64f4e6c0-9383-4d9a-8d53-74e89467a477 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.791s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-934b8652-ebaa-42e6-88f5-2233090b9a06 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-934b8652-ebaa-42e6-88f5-2233090b9a06 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:58 user nova-compute[75469]: DEBUG nova.compute.manager [None req-934b8652-ebaa-42e6-88f5-2233090b9a06 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:57:58 user nova-compute[75469]: DEBUG nova.compute.manager [None req-934b8652-ebaa-42e6-88f5-2233090b9a06 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75469) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 04:57:58 user nova-compute[75469]: DEBUG nova.objects.instance [None req-934b8652-ebaa-42e6-88f5-2233090b9a06 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:57:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:59 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance destroyed successfully.
Nov 14 04:57:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-934b8652-ebaa-42e6-88f5-2233090b9a06 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-934b8652-ebaa-42e6-88f5-2233090b9a06 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.922s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlDHeWoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:57:59 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:57:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:57:59 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:57:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:57:59 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:57:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fc071b-8e94-4ee8-9e2e-d38ab5d40d23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:57:59 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-01e6192b-9f57-45a0-a922-ab29edd55978 req-d24e5e4b-e211-409c-822e-0545528031e4 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-01e6192b-9f57-45a0-a922-ab29edd55978 req-d24e5e4b-e211-409c-822e-0545528031e4 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-01e6192b-9f57-45a0-a922-ab29edd55978 req-d24e5e4b-e211-409c-822e-0545528031e4 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-01e6192b-9f57-45a0-a922-ab29edd55978 req-d24e5e4b-e211-409c-822e-0545528031e4 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-01e6192b-9f57-45a0-a922-ab29edd55978 req-d24e5e4b-e211-409c-822e-0545528031e4 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:57:59 user nova-compute[75469]: WARNING nova.compute.manager [req-01e6192b-9f57-45a0-a922-ab29edd55978 req-d24e5e4b-e211-409c-822e-0545528031e4 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state stopped and task_state None.
Nov 14 04:57:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eb2e0e-af8a-4632-9368-0952c0a99d7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef] added
Nov 14 04:57:59 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:57:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a6dec1-7d19-42d0-804f-3793427a64e7]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e1bb43-24d2-4596-ae56-87e121c34334]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SlDHeWoj {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SlDHeWoj" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc0dbae-5af7-4123-b3e3-ec459a465e30]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SlDHeWoj'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1440027d-3fb5-49e6-85bd-cdd03b5394f8]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee07e27-59af-432a-b233-299cd1fcf155]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:00 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:00 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:00 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:00 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f44c54-46ab-4c93-a041-9edcbe55cd20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef, portal: 172.16.0.220,3260]
Nov 14 04:58:00 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef, portal: 172.16.0.220,3260] successful.
Nov 14 04:58:00 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.129s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ee1396-0e0d-4dd4-9fbc-66e45af203b2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d52bb0-8125-4cd1-acc5-12ee3626c90e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:00 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:00 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:58:00 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:00 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:00 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:58:00 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.485s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bd73f1-9319-4459-8c81-0f17f5ccecce]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlDHeWoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:01 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.527s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:58:01 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] <== connect_volume: return (1530ms) {'type': 'block', 'scsi_wwn': '23338336363633234', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:58:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338336363633234', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:58:01 user nova-compute[75469]: DEBUG nova.objects.instance [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'flavor' on Instance uuid 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:58:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:58:01 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:58:01 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 04:58:01 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:58:01 user nova-compute[75469]:   <serial>a43a992e-b094-4204-9025-17f075f217ef</serial>
Nov 14 04:58:01 user nova-compute[75469]: </disk>
Nov 14 04:58:01 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:58:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:58:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:58:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No VIF found with MAC fa:16:3e:a3:b1:4e, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5b23e2b-8510-46d1-8a36-634968d4abea tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.070s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:02 user nova-compute[75469]: WARNING nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state stopped and task_state None.
Nov 14 04:58:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:02 user nova-compute[75469]: WARNING nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state stopped and task_state None.
Nov 14 04:58:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:02 user nova-compute[75469]: WARNING nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state stopped and task_state None.
Nov 14 04:58:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:02 user nova-compute[75469]: WARNING nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state stopped and task_state None.
Nov 14 04:58:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:02 user nova-compute[75469]: WARNING nova.compute.manager [req-a32cbe91-aeaf-4810-950d-b41014a28cec req-214f21ae-f8dc-43b1-abad-e437920817c8 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state stopped and task_state None.
Nov 14 04:58:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "708da3a8-c9ce-4d36-87f4-658756b11481" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:58:05 user nova-compute[75469]: INFO nova.compute.claims [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Claim successful on node user
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.806s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:58:05 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.policy [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e34deb5afff54a04905b7a67fef9a6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1ce6a2889c4e7892cedf0074e02a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:58:05 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Creating image(s)
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "/opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "/opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "/opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "00eaa54c-e711-4c19-adbe-ed90dcc46293" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:58:05 user nova-compute[75469]: INFO nova.compute.claims [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Claim successful on node user
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk 1073741824" returned: 0 in 0.064s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Successfully created port: c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Cannot resize image /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Ensure instance console log exists: /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:58:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:58:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Creating image(s)
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "/opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "/opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "/opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:06 user nova-compute[75469]: DEBUG nova.policy [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e98acc8e0c8044cca5d6f7a35b3bdad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59f6cc7c2254d4ba2581a445e02075f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk 1073741824" returned: 0 in 0.045s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Cannot resize image /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Ensure instance console log exists: /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Successfully updated port: c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "refresh_cache-708da3a8-c9ce-4d36-87f4-658756b11481" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquired lock "refresh_cache-708da3a8-c9ce-4d36-87f4-658756b11481" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-a4ae6797-43ec-46d6-bf20-aecd3e81549c req-1593f4a6-1c6e-4975-9686-228b4afa7bba service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Received event network-changed-c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-a4ae6797-43ec-46d6-bf20-aecd3e81549c req-1593f4a6-1c6e-4975-9686-228b4afa7bba service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Refreshing instance network info cache due to event network-changed-c9835e10-aae6-469f-b1dc-7a6216a58e07. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a4ae6797-43ec-46d6-bf20-aecd3e81549c req-1593f4a6-1c6e-4975-9686-228b4afa7bba service nova] Acquiring lock "refresh_cache-708da3a8-c9ce-4d36-87f4-658756b11481" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Successfully created port: 3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:58:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Updating instance_info_cache with network_info: [{"id": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "address": "fa:16:3e:dc:92:d0", "network": {"id": "a0ea6d0c-3672-45ef-8b6d-252e834a4c8a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-207125075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db1ce6a2889c4e7892cedf0074e02a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9835e10-aa", "ovs_interfaceid": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Releasing lock "refresh_cache-708da3a8-c9ce-4d36-87f4-658756b11481" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Instance network_info: |[{"id": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "address": "fa:16:3e:dc:92:d0", "network": {"id": "a0ea6d0c-3672-45ef-8b6d-252e834a4c8a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-207125075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db1ce6a2889c4e7892cedf0074e02a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9835e10-aa", "ovs_interfaceid": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a4ae6797-43ec-46d6-bf20-aecd3e81549c req-1593f4a6-1c6e-4975-9686-228b4afa7bba service nova] Acquired lock "refresh_cache-708da3a8-c9ce-4d36-87f4-658756b11481" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.network.neutron [req-a4ae6797-43ec-46d6-bf20-aecd3e81549c req-1593f4a6-1c6e-4975-9686-228b4afa7bba service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Refreshing network info cache for port c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Start _get_guest_xml network_info=[{"id": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "address": "fa:16:3e:dc:92:d0", "network": {"id": "a0ea6d0c-3672-45ef-8b6d-252e834a4c8a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-207125075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db1ce6a2889c4e7892cedf0074e02a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9835e10-aa", "ovs_interfaceid": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:58:08 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:58:08 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:58:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1076659333',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1076659333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1076659',id=19,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiiIIB2rVvmID42UMPWNYeutQ1H5DSG3Y7OCV4E9+yy5mBOyDOmxgDhQPsyszfBABmjx4+uPEbvconyt2lAE6KWvQnqSKKh51Ml6Z4HotePU1XKstWiqF7QA8yT67lDTg==',key_name='tempest-keypair-1105485361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db1ce6a2889c4e7892cedf0074e02a8e',ramdisk_id='',reservation_id='r-d8i93sav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1654385870',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:58:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e34deb5afff54a04905b7a67fef9a6c0',uuid=708da3a8-c9ce-4d36-87f4-658756b11481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "address": "fa:16:3e:dc:92:d0", "network": {"id": "a0ea6d0c-3672-45ef-8b6d-252e834a4c8a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-207125075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db1ce6a2889c4e7892cedf0074e02a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9835e10-aa", "ovs_interfaceid": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Converting VIF {"id": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "address": "fa:16:3e:dc:92:d0", "network": {"id": "a0ea6d0c-3672-45ef-8b6d-252e834a4c8a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-207125075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db1ce6a2889c4e7892cedf0074e02a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9835e10-aa", "ovs_interfaceid": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=c9835e10-aae6-469f-b1dc-7a6216a58e07,network=Network(a0ea6d0c-3672-45ef-8b6d-252e834a4c8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9835e10-aa') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.objects.instance [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lazy-loading 'pci_devices' on Instance uuid 708da3a8-c9ce-4d36-87f4-658756b11481 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:58:08 user nova-compute[75469]:   <uuid>708da3a8-c9ce-4d36-87f4-658756b11481</uuid>
Nov 14 04:58:08 user nova-compute[75469]:   <name>instance-00000013</name>
Nov 14 04:58:08 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:58:08 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:58:08 user nova-compute[75469]:   <metadata>
Nov 14 04:58:08 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:58:08 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:58:08 user nova-compute[75469]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1076659333</nova:name>
Nov 14 04:58:08 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:58:08</nova:creationTime>
Nov 14 04:58:08 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:58:08 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:58:08 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:58:08 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:58:08 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:58:08 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:58:08 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:58:08 user nova-compute[75469]:       <nova:owner>
Nov 14 04:58:08 user nova-compute[75469]:         <nova:user uuid="e34deb5afff54a04905b7a67fef9a6c0">tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member</nova:user>
Nov 14 04:58:08 user nova-compute[75469]:         <nova:project uuid="db1ce6a2889c4e7892cedf0074e02a8e">tempest-TestServerVolumeAttachScenarioOldVersion-1654385870</nova:project>
Nov 14 04:58:08 user nova-compute[75469]:       </nova:owner>
Nov 14 04:58:08 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:58:08 user nova-compute[75469]:       <nova:ports>
Nov 14 04:58:08 user nova-compute[75469]:         <nova:port uuid="c9835e10-aae6-469f-b1dc-7a6216a58e07">
Nov 14 04:58:08 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 04:58:08 user nova-compute[75469]:         </nova:port>
Nov 14 04:58:08 user nova-compute[75469]:       </nova:ports>
Nov 14 04:58:08 user nova-compute[75469]:     </nova:instance>
Nov 14 04:58:08 user nova-compute[75469]:   </metadata>
Nov 14 04:58:08 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:58:08 user nova-compute[75469]:     <system>
Nov 14 04:58:08 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:58:08 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:58:08 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:58:08 user nova-compute[75469]:       <entry name="serial">708da3a8-c9ce-4d36-87f4-658756b11481</entry>
Nov 14 04:58:08 user nova-compute[75469]:       <entry name="uuid">708da3a8-c9ce-4d36-87f4-658756b11481</entry>
Nov 14 04:58:08 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:58:08 user nova-compute[75469]:     </system>
Nov 14 04:58:08 user nova-compute[75469]:   </sysinfo>
Nov 14 04:58:08 user nova-compute[75469]:   <os>
Nov 14 04:58:08 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:58:08 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:58:08 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:58:08 user nova-compute[75469]:   </os>
Nov 14 04:58:08 user nova-compute[75469]:   <features>
Nov 14 04:58:08 user nova-compute[75469]:     <acpi/>
Nov 14 04:58:08 user nova-compute[75469]:     <apic/>
Nov 14 04:58:08 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:58:08 user nova-compute[75469]:   </features>
Nov 14 04:58:08 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:58:08 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:58:08 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:58:08 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:58:08 user nova-compute[75469]:   </clock>
Nov 14 04:58:08 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:58:08 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:58:08 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:58:08 user nova-compute[75469]:   </cpu>
Nov 14 04:58:08 user nova-compute[75469]:   <devices>
Nov 14 04:58:08 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:58:08 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:58:08 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk"/>
Nov 14 04:58:08 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:58:08 user nova-compute[75469]:     </disk>
Nov 14 04:58:08 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:58:08 user nova-compute[75469]:       <mac address="fa:16:3e:dc:92:d0"/>
Nov 14 04:58:08 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:58:08 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:58:08 user nova-compute[75469]:       <target dev="tapc9835e10-aa"/>
Nov 14 04:58:08 user nova-compute[75469]:     </interface>
Nov 14 04:58:08 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:58:08 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/console.log" append="off"/>
Nov 14 04:58:08 user nova-compute[75469]:     </serial>
Nov 14 04:58:08 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:58:08 user nova-compute[75469]:     <video>
Nov 14 04:58:08 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:58:08 user nova-compute[75469]:     </video>
Nov 14 04:58:08 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:58:08 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:58:08 user nova-compute[75469]:     </rng>
Nov 14 04:58:08 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:58:08 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:58:08 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:58:08 user nova-compute[75469]:     </memballoon>
Nov 14 04:58:08 user nova-compute[75469]:   </devices>
Nov 14 04:58:08 user nova-compute[75469]: </domain>
Nov 14 04:58:08 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:58:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1076659333',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1076659333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1076659',id=19,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiiIIB2rVvmID42UMPWNYeutQ1H5DSG3Y7OCV4E9+yy5mBOyDOmxgDhQPsyszfBABmjx4+uPEbvconyt2lAE6KWvQnqSKKh51Ml6Z4HotePU1XKstWiqF7QA8yT67lDTg==',key_name='tempest-keypair-1105485361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db1ce6a2889c4e7892cedf0074e02a8e',ramdisk_id='',reservation_id='r-d8i93sav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1654385870',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:58:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e34deb5afff54a04905b7a67fef9a6c0',uuid=708da3a8-c9ce-4d36-87f4-658756b11481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "address": "fa:16:3e:dc:92:d0", "network": {"id": "a0ea6d0c-3672-45ef-8b6d-252e834a4c8a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-207125075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db1ce6a2889c4e7892cedf0074e02a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9835e10-aa", "ovs_interfaceid": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Converting VIF {"id": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "address": "fa:16:3e:dc:92:d0", "network": {"id": "a0ea6d0c-3672-45ef-8b6d-252e834a4c8a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-207125075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db1ce6a2889c4e7892cedf0074e02a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9835e10-aa", "ovs_interfaceid": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=c9835e10-aae6-469f-b1dc-7a6216a58e07,network=Network(a0ea6d0c-3672-45ef-8b6d-252e834a4c8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9835e10-aa') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG os_vif [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=c9835e10-aae6-469f-b1dc-7a6216a58e07,network=Network(a0ea6d0c-3672-45ef-8b6d-252e834a4c8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9835e10-aa') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'daf92217-c8c9-59dd-8b79-f9e9fa4d56f3', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9835e10-aa, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9835e10-aa, col_values=(('qos', UUID('b9c2d4b7-61c5-4f01-bbcb-db06b7ab57b4')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9835e10-aa, col_values=(('external_ids', {'iface-id': 'c9835e10-aae6-469f-b1dc-7a6216a58e07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:92:d0', 'vm-uuid': '708da3a8-c9ce-4d36-87f4-658756b11481'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:08 user nova-compute[75469]: INFO os_vif [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=c9835e10-aae6-469f-b1dc-7a6216a58e07,network=Network(a0ea6d0c-3672-45ef-8b6d-252e834a4c8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9835e10-aa')
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:58:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] No VIF found with MAC fa:16:3e:dc:92:d0, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-a4ae6797-43ec-46d6-bf20-aecd3e81549c req-1593f4a6-1c6e-4975-9686-228b4afa7bba service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Updated VIF entry in instance network info cache for port c9835e10-aae6-469f-b1dc-7a6216a58e07. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-a4ae6797-43ec-46d6-bf20-aecd3e81549c req-1593f4a6-1c6e-4975-9686-228b4afa7bba service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Updating instance_info_cache with network_info: [{"id": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "address": "fa:16:3e:dc:92:d0", "network": {"id": "a0ea6d0c-3672-45ef-8b6d-252e834a4c8a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-207125075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db1ce6a2889c4e7892cedf0074e02a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9835e10-aa", "ovs_interfaceid": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a4ae6797-43ec-46d6-bf20-aecd3e81549c req-1593f4a6-1c6e-4975-9686-228b4afa7bba service nova] Releasing lock "refresh_cache-708da3a8-c9ce-4d36-87f4-658756b11481" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Successfully updated port: 3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "refresh_cache-00eaa54c-e711-4c19-adbe-ed90dcc46293" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquired lock "refresh_cache-00eaa54c-e711-4c19-adbe-ed90dcc46293" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Updating instance_info_cache with network_info: [{"id": "3b440674-f174-4469-9053-32e9b4b6a193", "address": "fa:16:3e:6c:25:8b", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b440674-f1", "ovs_interfaceid": "3b440674-f174-4469-9053-32e9b4b6a193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Releasing lock "refresh_cache-00eaa54c-e711-4c19-adbe-ed90dcc46293" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Instance network_info: |[{"id": "3b440674-f174-4469-9053-32e9b4b6a193", "address": "fa:16:3e:6c:25:8b", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b440674-f1", "ovs_interfaceid": "3b440674-f174-4469-9053-32e9b4b6a193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Start _get_guest_xml network_info=[{"id": "3b440674-f174-4469-9053-32e9b4b6a193", "address": "fa:16:3e:6c:25:8b", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b440674-f1", "ovs_interfaceid": "3b440674-f174-4469-9053-32e9b4b6a193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:58:09 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:58:09 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1908253860',display_name='tempest-AttachVolumeNegativeTest-server-1908253860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1908253860',id=20,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeZiMeIlmtDa0CSAzZGcAeyZ/+edk3NnuPPx3tPNIoaWTZ9r+Mb7b3HsHj92XWClP3U9/8deSsX5o1yBJNd264M0MI0S/WTBqglVYebjcPmmZJ3vhG30IZvak23Ffulqg==',key_name='tempest-keypair-1258865171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-mm0w092z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=00eaa54c-e711-4c19-adbe-ed90dcc46293,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b440674-f174-4469-9053-32e9b4b6a193", "address": "fa:16:3e:6c:25:8b", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b440674-f1", "ovs_interfaceid": "3b440674-f174-4469-9053-32e9b4b6a193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "3b440674-f174-4469-9053-32e9b4b6a193", "address": "fa:16:3e:6c:25:8b", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b440674-f1", "ovs_interfaceid": "3b440674-f174-4469-9053-32e9b4b6a193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:25:8b,bridge_name='br-int',has_traffic_filtering=True,id=3b440674-f174-4469-9053-32e9b4b6a193,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b440674-f1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.objects.instance [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'pci_devices' on Instance uuid 00eaa54c-e711-4c19-adbe-ed90dcc46293 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:58:09 user nova-compute[75469]:   <uuid>00eaa54c-e711-4c19-adbe-ed90dcc46293</uuid>
Nov 14 04:58:09 user nova-compute[75469]:   <name>instance-00000014</name>
Nov 14 04:58:09 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:58:09 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:58:09 user nova-compute[75469]:   <metadata>
Nov 14 04:58:09 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:58:09 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:58:09 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1908253860</nova:name>
Nov 14 04:58:09 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:58:09</nova:creationTime>
Nov 14 04:58:09 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:58:09 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:58:09 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:58:09 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:58:09 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:58:09 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:58:09 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:58:09 user nova-compute[75469]:       <nova:owner>
Nov 14 04:58:09 user nova-compute[75469]:         <nova:user uuid="e98acc8e0c8044cca5d6f7a35b3bdad0">tempest-AttachVolumeNegativeTest-1768463318-project-member</nova:user>
Nov 14 04:58:09 user nova-compute[75469]:         <nova:project uuid="c59f6cc7c2254d4ba2581a445e02075f">tempest-AttachVolumeNegativeTest-1768463318</nova:project>
Nov 14 04:58:09 user nova-compute[75469]:       </nova:owner>
Nov 14 04:58:09 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:58:09 user nova-compute[75469]:       <nova:ports>
Nov 14 04:58:09 user nova-compute[75469]:         <nova:port uuid="3b440674-f174-4469-9053-32e9b4b6a193">
Nov 14 04:58:09 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 04:58:09 user nova-compute[75469]:         </nova:port>
Nov 14 04:58:09 user nova-compute[75469]:       </nova:ports>
Nov 14 04:58:09 user nova-compute[75469]:     </nova:instance>
Nov 14 04:58:09 user nova-compute[75469]:   </metadata>
Nov 14 04:58:09 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:58:09 user nova-compute[75469]:     <system>
Nov 14 04:58:09 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:58:09 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:58:09 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:58:09 user nova-compute[75469]:       <entry name="serial">00eaa54c-e711-4c19-adbe-ed90dcc46293</entry>
Nov 14 04:58:09 user nova-compute[75469]:       <entry name="uuid">00eaa54c-e711-4c19-adbe-ed90dcc46293</entry>
Nov 14 04:58:09 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:58:09 user nova-compute[75469]:     </system>
Nov 14 04:58:09 user nova-compute[75469]:   </sysinfo>
Nov 14 04:58:09 user nova-compute[75469]:   <os>
Nov 14 04:58:09 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:58:09 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:58:09 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:58:09 user nova-compute[75469]:   </os>
Nov 14 04:58:09 user nova-compute[75469]:   <features>
Nov 14 04:58:09 user nova-compute[75469]:     <acpi/>
Nov 14 04:58:09 user nova-compute[75469]:     <apic/>
Nov 14 04:58:09 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:58:09 user nova-compute[75469]:   </features>
Nov 14 04:58:09 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:58:09 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:58:09 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:58:09 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:58:09 user nova-compute[75469]:   </clock>
Nov 14 04:58:09 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:58:09 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:58:09 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:58:09 user nova-compute[75469]:   </cpu>
Nov 14 04:58:09 user nova-compute[75469]:   <devices>
Nov 14 04:58:09 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:58:09 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:58:09 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk"/>
Nov 14 04:58:09 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:58:09 user nova-compute[75469]:     </disk>
Nov 14 04:58:09 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:58:09 user nova-compute[75469]:       <mac address="fa:16:3e:6c:25:8b"/>
Nov 14 04:58:09 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:58:09 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:58:09 user nova-compute[75469]:       <target dev="tap3b440674-f1"/>
Nov 14 04:58:09 user nova-compute[75469]:     </interface>
Nov 14 04:58:09 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:58:09 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/console.log" append="off"/>
Nov 14 04:58:09 user nova-compute[75469]:     </serial>
Nov 14 04:58:09 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:58:09 user nova-compute[75469]:     <video>
Nov 14 04:58:09 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:58:09 user nova-compute[75469]:     </video>
Nov 14 04:58:09 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:58:09 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:58:09 user nova-compute[75469]:     </rng>
Nov 14 04:58:09 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:58:09 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:58:09 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:58:09 user nova-compute[75469]:     </memballoon>
Nov 14 04:58:09 user nova-compute[75469]:   </devices>
Nov 14 04:58:09 user nova-compute[75469]: </domain>
Nov 14 04:58:09 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1908253860',display_name='tempest-AttachVolumeNegativeTest-server-1908253860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1908253860',id=20,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeZiMeIlmtDa0CSAzZGcAeyZ/+edk3NnuPPx3tPNIoaWTZ9r+Mb7b3HsHj92XWClP3U9/8deSsX5o1yBJNd264M0MI0S/WTBqglVYebjcPmmZJ3vhG30IZvak23Ffulqg==',key_name='tempest-keypair-1258865171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-mm0w092z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=00eaa54c-e711-4c19-adbe-ed90dcc46293,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b440674-f174-4469-9053-32e9b4b6a193", "address": "fa:16:3e:6c:25:8b", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b440674-f1", "ovs_interfaceid": "3b440674-f174-4469-9053-32e9b4b6a193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "3b440674-f174-4469-9053-32e9b4b6a193", "address": "fa:16:3e:6c:25:8b", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b440674-f1", "ovs_interfaceid": "3b440674-f174-4469-9053-32e9b4b6a193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:25:8b,bridge_name='br-int',has_traffic_filtering=True,id=3b440674-f174-4469-9053-32e9b4b6a193,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b440674-f1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG os_vif [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:25:8b,bridge_name='br-int',has_traffic_filtering=True,id=3b440674-f174-4469-9053-32e9b4b6a193,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b440674-f1') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10dd4178-0d1e-5e39-87b8-839710e30459', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b440674-f1, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b440674-f1, col_values=(('qos', UUID('c1b96114-08d5-49b0-8fee-19674525aa5c')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b440674-f1, col_values=(('external_ids', {'iface-id': '3b440674-f174-4469-9053-32e9b4b6a193', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:25:8b', 'vm-uuid': '00eaa54c-e711-4c19-adbe-ed90dcc46293'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:09 user nova-compute[75469]: INFO os_vif [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:25:8b,bridge_name='br-int',has_traffic_filtering=True,id=3b440674-f174-4469-9053-32e9b4b6a193,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b440674-f1')
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No VIF found with MAC fa:16:3e:6c:25:8b, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-6dc99517-0d71-4568-9893-269d2b68ce64 req-86481f35-9e8f-4e91-8590-1591b032a8e4 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Received event network-changed-3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-6dc99517-0d71-4568-9893-269d2b68ce64 req-86481f35-9e8f-4e91-8590-1591b032a8e4 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Refreshing instance network info cache due to event network-changed-3b440674-f174-4469-9053-32e9b4b6a193. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6dc99517-0d71-4568-9893-269d2b68ce64 req-86481f35-9e8f-4e91-8590-1591b032a8e4 service nova] Acquiring lock "refresh_cache-00eaa54c-e711-4c19-adbe-ed90dcc46293" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6dc99517-0d71-4568-9893-269d2b68ce64 req-86481f35-9e8f-4e91-8590-1591b032a8e4 service nova] Acquired lock "refresh_cache-00eaa54c-e711-4c19-adbe-ed90dcc46293" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:58:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-6dc99517-0d71-4568-9893-269d2b68ce64 req-86481f35-9e8f-4e91-8590-1591b032a8e4 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Refreshing network info cache for port 3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-79312376-7452-42ad-bd3d-57006a24c39f req-c078c2cd-d60a-489c-9059-70e55d977554 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Received event network-vif-plugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-79312376-7452-42ad-bd3d-57006a24c39f req-c078c2cd-d60a-489c-9059-70e55d977554 service nova] Acquiring lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-79312376-7452-42ad-bd3d-57006a24c39f req-c078c2cd-d60a-489c-9059-70e55d977554 service nova] Lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-79312376-7452-42ad-bd3d-57006a24c39f req-c078c2cd-d60a-489c-9059-70e55d977554 service nova] Lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-79312376-7452-42ad-bd3d-57006a24c39f req-c078c2cd-d60a-489c-9059-70e55d977554 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] No waiting events found dispatching network-vif-plugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:10 user nova-compute[75469]: WARNING nova.compute.manager [req-79312376-7452-42ad-bd3d-57006a24c39f req-c078c2cd-d60a-489c-9059-70e55d977554 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Received unexpected event network-vif-plugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 for instance with vm_state building and task_state spawning.
Nov 14 04:58:10 user nova-compute[75469]: DEBUG nova.network.neutron [req-6dc99517-0d71-4568-9893-269d2b68ce64 req-86481f35-9e8f-4e91-8590-1591b032a8e4 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Updated VIF entry in instance network info cache for port 3b440674-f174-4469-9053-32e9b4b6a193. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG nova.network.neutron [req-6dc99517-0d71-4568-9893-269d2b68ce64 req-86481f35-9e8f-4e91-8590-1591b032a8e4 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Updating instance_info_cache with network_info: [{"id": "3b440674-f174-4469-9053-32e9b4b6a193", "address": "fa:16:3e:6c:25:8b", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b440674-f1", "ovs_interfaceid": "3b440674-f174-4469-9053-32e9b4b6a193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6dc99517-0d71-4568-9893-269d2b68ce64 req-86481f35-9e8f-4e91-8590-1591b032a8e4 service nova] Releasing lock "refresh_cache-00eaa54c-e711-4c19-adbe-ed90dcc46293" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Received event network-vif-plugged-3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] Acquiring lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] No waiting events found dispatching network-vif-plugged-3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:11 user nova-compute[75469]: WARNING nova.compute.manager [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Received unexpected event network-vif-plugged-3b440674-f174-4469-9053-32e9b4b6a193 for instance with vm_state building and task_state spawning.
Nov 14 04:58:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Received event network-vif-plugged-3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] Acquiring lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] No waiting events found dispatching network-vif-plugged-3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:11 user nova-compute[75469]: WARNING nova.compute.manager [req-b74b6634-9baa-4d57-8a0a-95656b36b1c4 req-640f53b7-b0da-4b2e-8e98-373c9960928b service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Received unexpected event network-vif-plugged-3b440674-f174-4469-9053-32e9b4b6a193 for instance with vm_state building and task_state spawning.
Nov 14 04:58:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-b71410da-a6ee-42ca-98c6-63b10cdcee4e req-119fe62d-d2ba-4bb9-9c9e-70f571efa9b0 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Received event network-vif-plugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b71410da-a6ee-42ca-98c6-63b10cdcee4e req-119fe62d-d2ba-4bb9-9c9e-70f571efa9b0 service nova] Acquiring lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b71410da-a6ee-42ca-98c6-63b10cdcee4e req-119fe62d-d2ba-4bb9-9c9e-70f571efa9b0 service nova] Lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b71410da-a6ee-42ca-98c6-63b10cdcee4e req-119fe62d-d2ba-4bb9-9c9e-70f571efa9b0 service nova] Lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-b71410da-a6ee-42ca-98c6-63b10cdcee4e req-119fe62d-d2ba-4bb9-9c9e-70f571efa9b0 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] No waiting events found dispatching network-vif-plugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:12 user nova-compute[75469]: WARNING nova.compute.manager [req-b71410da-a6ee-42ca-98c6-63b10cdcee4e req-119fe62d-d2ba-4bb9-9c9e-70f571efa9b0 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Received unexpected event network-vif-plugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 for instance with vm_state building and task_state spawning.
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:58:13 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Instance spawned successfully.
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: INFO nova.compute.manager [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:58:13 user nova-compute[75469]: INFO nova.compute.manager [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Took 8.97 seconds to build instance.
Nov 14 04:58:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a8be75d4-190f-4e12-bf22-933d722de451 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.116s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:58:13 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Instance spawned successfully.
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:58:13 user nova-compute[75469]: INFO nova.compute.manager [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Took 6.99 seconds to spawn the instance on the hypervisor.
Nov 14 04:58:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:58:13 user nova-compute[75469]: INFO nova.compute.manager [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Took 7.90 seconds to build instance.
Nov 14 04:58:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a07c0234-636e-4c51-bba3-1c242114fef2 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.986s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-f88ff719-82ca-451e-ad84-be8b7a0531ed req-ee9e7c62-65a9-4034-97f7-87311b29b4b7 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Received event network-changed-237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-f88ff719-82ca-451e-ad84-be8b7a0531ed req-ee9e7c62-65a9-4034-97f7-87311b29b4b7 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Refreshing instance network info cache due to event network-changed-237bd97e-c773-4221-a0e0-ce00162f3336. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:58:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f88ff719-82ca-451e-ad84-be8b7a0531ed req-ee9e7c62-65a9-4034-97f7-87311b29b4b7 service nova] Acquiring lock "refresh_cache-5c7280e0-6117-48b8-8406-276edcc2051c" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:58:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f88ff719-82ca-451e-ad84-be8b7a0531ed req-ee9e7c62-65a9-4034-97f7-87311b29b4b7 service nova] Acquired lock "refresh_cache-5c7280e0-6117-48b8-8406-276edcc2051c" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:58:20 user nova-compute[75469]: DEBUG nova.network.neutron [req-f88ff719-82ca-451e-ad84-be8b7a0531ed req-ee9e7c62-65a9-4034-97f7-87311b29b4b7 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Refreshing network info cache for port 237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:58:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "5c7280e0-6117-48b8-8406-276edcc2051c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:20 user nova-compute[75469]: DEBUG nova.objects.instance [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lazy-loading 'flavor' on Instance uuid 5c7280e0-6117-48b8-8406-276edcc2051c {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:58:20 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Ignoring supplied device name: /dev/vdb
Nov 14 04:58:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG nova.network.neutron [req-f88ff719-82ca-451e-ad84-be8b7a0531ed req-ee9e7c62-65a9-4034-97f7-87311b29b4b7 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Updated VIF entry in instance network info cache for port 237bd97e-c773-4221-a0e0-ce00162f3336. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG nova.network.neutron [req-f88ff719-82ca-451e-ad84-be8b7a0531ed req-ee9e7c62-65a9-4034-97f7-87311b29b4b7 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Updating instance_info_cache with network_info: [{"id": "237bd97e-c773-4221-a0e0-ce00162f3336", "address": "fa:16:3e:9c:01:59", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237bd97e-c7", "ovs_interfaceid": "237bd97e-c773-4221-a0e0-ce00162f3336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "5c7280e0-6117-48b8-8406-276edcc2051c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:21 user nova-compute[75469]: INFO nova.compute.manager [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Attaching volume d166e318-544b-4cca-aca5-538763cd0dab to /dev/vdb
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f88ff719-82ca-451e-ad84-be8b7a0531ed req-ee9e7c62-65a9-4034-97f7-87311b29b4b7 service nova] Releasing lock "refresh_cache-5c7280e0-6117-48b8-8406-276edcc2051c" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG os_brick.utils [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc3a5de-7872-44e7-a3be-b82e4b3f0f6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdb320e-cf38-47c3-8151-0a32ee2d3467]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[67de4d55-cc30-4369-88ce-c42d75e541ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad00a606-6374-48d3-93db-62d3fa757eba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:58:21 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:58:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e90f06-26e1-4481-97ed-a371b11a44ba]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG os_brick.utils [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:58:21 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Updating existing volume attachment record: 7f71f931-4540-4c5a-9dc6-67ef615f5e09 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:23 user nova-compute[75469]: INFO nova.compute.manager [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Terminating instance
Nov 14 04:58:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-2fefad2e-bf7f-4442-815e-4ee7ae718a88 req-2c934421-a628-46f1-9ca2-736ae933a051 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-vif-unplugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2fefad2e-bf7f-4442-815e-4ee7ae718a88 req-2c934421-a628-46f1-9ca2-736ae933a051 service nova] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2fefad2e-bf7f-4442-815e-4ee7ae718a88 req-2c934421-a628-46f1-9ca2-736ae933a051 service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2fefad2e-bf7f-4442-815e-4ee7ae718a88 req-2c934421-a628-46f1-9ca2-736ae933a051 service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-2fefad2e-bf7f-4442-815e-4ee7ae718a88 req-2c934421-a628-46f1-9ca2-736ae933a051 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] No waiting events found dispatching network-vif-unplugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-2fefad2e-bf7f-4442-815e-4ee7ae718a88 req-2c934421-a628-46f1-9ca2-736ae933a051 service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-vif-unplugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:58:24 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Instance destroyed successfully.
Nov 14 04:58:24 user nova-compute[75469]: DEBUG nova.objects.instance [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'resources' on Instance uuid fbbae8e3-5d56-41ed-9be2-8856c3420f44 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T04:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-864532062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-864532062',id=5,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJxiXPqJ+9+ZxyO6Uypnua2AMVUYfA5aTo9i6T6J9NsbMbvS1ODQw3d9jf076JfAUED2qfOIr52fC3va9mIfCd/X6AwXEVw/N/gscS3X8nizJZYWlkeEX3UqEz1ZSu22g==',key_name='tempest-keypair-1957997782',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:56:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-458dg48g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:56:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=fbbae8e3-5d56-41ed-9be2-8856c3420f44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "address": "fa:16:3e:a9:9c:ef", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5b49c15-84", "ovs_interfaceid": "d5b49c15-8461-4b3c-aa57-0dcdd7b12305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG os_vif [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5b49c15-84, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdb30aca-118d-40a8-82dd-8ed77347a276) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:24 user nova-compute[75469]: INFO os_vif [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:ef,bridge_name='br-int',has_traffic_filtering=True,id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5b49c15-84')
Nov 14 04:58:24 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Deleting instance files /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44_del
Nov 14 04:58:24 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Deletion of /opt/stack/data/nova/instances/fbbae8e3-5d56-41ed-9be2-8856c3420f44_del complete
Nov 14 04:58:24 user nova-compute[75469]: INFO nova.compute.manager [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 04:58:24 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:58:24 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:58:25 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Took 0.90 seconds to deallocate network for instance.
Nov 14 04:58:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-f2a11278-f0fd-4281-899b-5a2ff37d3d56 req-4d138475-9dac-42f9-bd9b-51ff14641cda service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-vif-deleted-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:25 user nova-compute[75469]: INFO nova.compute.manager [req-f2a11278-f0fd-4281-899b-5a2ff37d3d56 req-4d138475-9dac-42f9-bd9b-51ff14641cda service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Neutron deleted interface d5b49c15-8461-4b3c-aa57-0dcdd7b12305; detaching it from the instance and deleting it from the info cache
Nov 14 04:58:25 user nova-compute[75469]: DEBUG nova.network.neutron [req-f2a11278-f0fd-4281-899b-5a2ff37d3d56 req-4d138475-9dac-42f9-bd9b-51ff14641cda service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-f2a11278-f0fd-4281-899b-5a2ff37d3d56 req-4d138475-9dac-42f9-bd9b-51ff14641cda service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Detach interface failed, port_id=d5b49c15-8461-4b3c-aa57-0dcdd7b12305, reason: Instance fbbae8e3-5d56-41ed-9be2-8856c3420f44 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:25 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Deleted allocations for instance fbbae8e3-5d56-41ed-9be2-8856c3420f44
Nov 14 04:58:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2514bf66-26db-47a1-985d-6fecb05ea9b2 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.305s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-85187091-30c0-48a6-8f12-462900a43b39 req-3cf3e3df-78b6-4a0b-b3f9-0361c117582b service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-85187091-30c0-48a6-8f12-462900a43b39 req-3cf3e3df-78b6-4a0b-b3f9-0361c117582b service nova] Acquiring lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-85187091-30c0-48a6-8f12-462900a43b39 req-3cf3e3df-78b6-4a0b-b3f9-0361c117582b service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-85187091-30c0-48a6-8f12-462900a43b39 req-3cf3e3df-78b6-4a0b-b3f9-0361c117582b service nova] Lock "fbbae8e3-5d56-41ed-9be2-8856c3420f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-85187091-30c0-48a6-8f12-462900a43b39 req-3cf3e3df-78b6-4a0b-b3f9-0361c117582b service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] No waiting events found dispatching network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:25 user nova-compute[75469]: WARNING nova.compute.manager [req-85187091-30c0-48a6-8f12-462900a43b39 req-3cf3e3df-78b6-4a0b-b3f9-0361c117582b service nova] [instance: fbbae8e3-5d56-41ed-9be2-8856c3420f44] Received unexpected event network-vif-plugged-d5b49c15-8461-4b3c-aa57-0dcdd7b12305 for instance with vm_state deleted and task_state None.
Nov 14 04:58:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZKVELvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:58:26 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:58:26 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:58:26 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8097eb3e-7a0e-4a6c-b8c8-b3c6fd4373b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:58:26 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63ecccc-8029-45fc-9d4b-1896fb8b3e8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab] added
Nov 14 04:58:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[12814b3f-b579-4d61-9731-b480f14965fd]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb989579-c613-40cf-821a-a9487f878da8]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZKVELvk {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZKVELvk" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6512bb-d5dd-45bd-89d5-c1eb274eb055]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eZKVELvk'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f480a2-65a5-4f6c-969e-acb3ef27e7f5]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff91bc0e-b031-47e5-88f7-b8cf5118242f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:26 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:26 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:58:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:26 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:26 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:58:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3b8e90-84c3-47c2-b41c-f8cf6bbf8c15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab, portal: 172.16.0.220,3260]
Nov 14 04:58:26 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab, portal: 172.16.0.220,3260] successful.
Nov 14 04:58:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9848be-91e9-4dfa-b7b6-f5eb1ac2d989]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77d963f-717e-47a8-8e12-89af78495624]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:26 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:26 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:58:26 user nova-compute[75469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab (non-flash)
Nov 14 04:58:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:26 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:26 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:58:26 user nova-compute[75469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab (non-flash)
Nov 14 04:58:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af12bb8-da6b-4cb0-a0ea-2936fb03df05]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:58:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZKVELvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:58:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:58:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26633613038633935', 'path': '/dev/sdd'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:58:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633613038633935', 'path': '/dev/sdd'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:58:27 user nova-compute[75469]: DEBUG nova.objects.instance [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lazy-loading 'flavor' on Instance uuid 5c7280e0-6117-48b8-8406-276edcc2051c {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:58:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:58:27 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:58:27 user nova-compute[75469]:   <source dev="/dev/sdd"/>
Nov 14 04:58:27 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:58:27 user nova-compute[75469]:   <serial>d166e318-544b-4cca-aca5-538763cd0dab</serial>
Nov 14 04:58:27 user nova-compute[75469]: </disk>
Nov 14 04:58:27 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:58:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:58:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:58:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] No VIF found with MAC fa:16:3e:9c:01:59, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:58:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c89efc7-d3a7-4321-8ad3-3ccfae5b69fe tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.983s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:29 user nova-compute[75469]: INFO nova.compute.manager [None req-e43b5739-1f68-4025-8249-a4f1fee8e128 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Unrescuing
Nov 14 04:58:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e43b5739-1f68-4025-8249-a4f1fee8e128 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:58:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e43b5739-1f68-4025-8249-a4f1fee8e128 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquired lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:58:29 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e43b5739-1f68-4025-8249-a4f1fee8e128 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:58:30 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e43b5739-1f68-4025-8249-a4f1fee8e128 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updating instance_info_cache with network_info: [{"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:58:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e43b5739-1f68-4025-8249-a4f1fee8e128 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Releasing lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:58:30 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e43b5739-1f68-4025-8249-a4f1fee8e128 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'flavor' on Instance uuid 929364ea-9d56-41ff-a393-8abd7df60eec {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:58:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-bbbe3b5f-8d43-4ccd-8ca3-de1e1b230331 req-549cce26-ec25-488c-9479-5b04617e2e9e service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-unplugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bbbe3b5f-8d43-4ccd-8ca3-de1e1b230331 req-549cce26-ec25-488c-9479-5b04617e2e9e service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bbbe3b5f-8d43-4ccd-8ca3-de1e1b230331 req-549cce26-ec25-488c-9479-5b04617e2e9e service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bbbe3b5f-8d43-4ccd-8ca3-de1e1b230331 req-549cce26-ec25-488c-9479-5b04617e2e9e service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-bbbe3b5f-8d43-4ccd-8ca3-de1e1b230331 req-549cce26-ec25-488c-9479-5b04617e2e9e service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-unplugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:30 user nova-compute[75469]: WARNING nova.compute.manager [req-bbbe3b5f-8d43-4ccd-8ca3-de1e1b230331 req-549cce26-ec25-488c-9479-5b04617e2e9e service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received unexpected event network-vif-unplugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with vm_state rescued and task_state unrescuing.
Nov 14 04:58:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Instance destroyed successfully.
Nov 14 04:58:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:32 user nova-compute[75469]: WARNING nova.compute.manager [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received unexpected event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with vm_state rescued and task_state unrescuing.
Nov 14 04:58:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:32 user nova-compute[75469]: WARNING nova.compute.manager [req-16857ddb-8549-4d97-b3aa-bcf9edd9d597 req-2870edec-e430-4e4c-895d-6521dafe0719 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received unexpected event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with vm_state rescued and task_state unrescuing.
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Acquiring lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Acquiring lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:34 user nova-compute[75469]: INFO nova.compute.manager [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Terminating instance
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e43b5739-1f68-4025-8249-a4f1fee8e128 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-8b7f3eab-28b3-4180-aee3-4a0ac64cf23d req-f8ef3233-2525-45fe-abb3-5c0deb6cabaa service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Received event network-vif-unplugged-bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8b7f3eab-28b3-4180-aee3-4a0ac64cf23d req-f8ef3233-2525-45fe-abb3-5c0deb6cabaa service nova] Acquiring lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8b7f3eab-28b3-4180-aee3-4a0ac64cf23d req-f8ef3233-2525-45fe-abb3-5c0deb6cabaa service nova] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8b7f3eab-28b3-4180-aee3-4a0ac64cf23d req-f8ef3233-2525-45fe-abb3-5c0deb6cabaa service nova] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-8b7f3eab-28b3-4180-aee3-4a0ac64cf23d req-f8ef3233-2525-45fe-abb3-5c0deb6cabaa service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] No waiting events found dispatching network-vif-unplugged-bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-8b7f3eab-28b3-4180-aee3-4a0ac64cf23d req-f8ef3233-2525-45fe-abb3-5c0deb6cabaa service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Received event network-vif-unplugged-bf891eef-8760-465c-9987-402d1604700f for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-2c67bda2-9d8e-4c1f-9c8a-7d9858de700b req-ba382724-e0a8-4b9f-9293-c5926ac86b02 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2c67bda2-9d8e-4c1f-9c8a-7d9858de700b req-ba382724-e0a8-4b9f-9293-c5926ac86b02 service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2c67bda2-9d8e-4c1f-9c8a-7d9858de700b req-ba382724-e0a8-4b9f-9293-c5926ac86b02 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2c67bda2-9d8e-4c1f-9c8a-7d9858de700b req-ba382724-e0a8-4b9f-9293-c5926ac86b02 service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-2c67bda2-9d8e-4c1f-9c8a-7d9858de700b req-ba382724-e0a8-4b9f-9293-c5926ac86b02 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:34 user nova-compute[75469]: WARNING nova.compute.manager [req-2c67bda2-9d8e-4c1f-9c8a-7d9858de700b req-ba382724-e0a8-4b9f-9293-c5926ac86b02 service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received unexpected event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with vm_state active and task_state None.
Nov 14 04:58:34 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Instance destroyed successfully.
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.objects.instance [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lazy-loading 'resources' on Instance uuid 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1089345000',display_name='tempest-VolumesNegativeTest-instance-1089345000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1089345000',id=17,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:56:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d4dfc8ceb83472c9fb44a09893a882c',ramdisk_id='',reservation_id='r-x7p2fw9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2114881959',owner_user_name='tempest-VolumesNegativeTest-2114881959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:56:52Z,user_data=None,user_id='265ebcebef7042559725423cb19361e7',uuid=89b01b8e-de64-4c2f-b5f8-b717b0fd16ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf891eef-8760-465c-9987-402d1604700f", "address": "fa:16:3e:0e:de:0e", "network": {"id": "03767120-d39f-4b62-ab5c-16a0194f6699", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f70bea45417a48dfbf060641403e50f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf891eef-87", "ovs_interfaceid": "bf891eef-8760-465c-9987-402d1604700f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Converting VIF {"id": "bf891eef-8760-465c-9987-402d1604700f", "address": "fa:16:3e:0e:de:0e", "network": {"id": "03767120-d39f-4b62-ab5c-16a0194f6699", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f70bea45417a48dfbf060641403e50f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf891eef-87", "ovs_interfaceid": "bf891eef-8760-465c-9987-402d1604700f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:de:0e,bridge_name='br-int',has_traffic_filtering=True,id=bf891eef-8760-465c-9987-402d1604700f,network=Network(03767120-d39f-4b62-ab5c-16a0194f6699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf891eef-87') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG os_vif [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:de:0e,bridge_name='br-int',has_traffic_filtering=True,id=bf891eef-8760-465c-9987-402d1604700f,network=Network(03767120-d39f-4b62-ab5c-16a0194f6699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf891eef-87') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf891eef-87, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d9e4293-7bf2-4b8b-acad-c86541ba3b1f) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:34 user nova-compute[75469]: INFO os_vif [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:de:0e,bridge_name='br-int',has_traffic_filtering=True,id=bf891eef-8760-465c-9987-402d1604700f,network=Network(03767120-d39f-4b62-ab5c-16a0194f6699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf891eef-87')
Nov 14 04:58:34 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Deleting instance files /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce_del
Nov 14 04:58:34 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Deletion of /opt/stack/data/nova/instances/89b01b8e-de64-4c2f-b5f8-b717b0fd16ce_del complete
Nov 14 04:58:34 user nova-compute[75469]: INFO nova.compute.manager [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 14 04:58:34 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:58:34 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:58:35 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:58:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "5c7280e0-6117-48b8-8406-276edcc2051c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:35 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Took 1.03 seconds to deallocate network for instance.
Nov 14 04:58:35 user nova-compute[75469]: INFO nova.compute.manager [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Detaching volume d166e318-544b-4cca-aca5-538763cd0dab
Nov 14 04:58:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:35 user nova-compute[75469]: INFO nova.virt.block_device [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Attempting to driver detach volume d166e318-544b-4cca-aca5-538763cd0dab from mountpoint /dev/vdb
Nov 14 04:58:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Attempting to detach device vdb from instance 5c7280e0-6117-48b8-8406-276edcc2051c from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:58:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:58:35 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:58:35 user nova-compute[75469]:   <source dev="/dev/sdd"/>
Nov 14 04:58:35 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:58:35 user nova-compute[75469]:   <serial>d166e318-544b-4cca-aca5-538763cd0dab</serial>
Nov 14 04:58:35 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:58:35 user nova-compute[75469]: </disk>
Nov 14 04:58:35 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:58:35 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Successfully detached device vdb from instance 5c7280e0-6117-48b8-8406-276edcc2051c from the persistent domain config.
Nov 14 04:58:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c7280e0-6117-48b8-8406-276edcc2051c from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:58:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:58:35 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:58:35 user nova-compute[75469]:   <source dev="/dev/sdd"/>
Nov 14 04:58:35 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:58:35 user nova-compute[75469]:   <serial>d166e318-544b-4cca-aca5-538763cd0dab</serial>
Nov 14 04:58:35 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:58:35 user nova-compute[75469]: </disk>
Nov 14 04:58:35 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:58:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "5c7280e0-6117-48b8-8406-276edcc2051c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:36 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:58:36 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:58:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:36 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Deleted allocations for instance 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce
Nov 14 04:58:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-9a312121-472b-41f1-bb75-888c1447c9fa req-fea0ee7b-876d-42cd-a9ee-03c607794fc2 service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Received event network-vif-plugged-bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9a312121-472b-41f1-bb75-888c1447c9fa req-fea0ee7b-876d-42cd-a9ee-03c607794fc2 service nova] Acquiring lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9a312121-472b-41f1-bb75-888c1447c9fa req-fea0ee7b-876d-42cd-a9ee-03c607794fc2 service nova] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9a312121-472b-41f1-bb75-888c1447c9fa req-fea0ee7b-876d-42cd-a9ee-03c607794fc2 service nova] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-9a312121-472b-41f1-bb75-888c1447c9fa req-fea0ee7b-876d-42cd-a9ee-03c607794fc2 service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] No waiting events found dispatching network-vif-plugged-bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:36 user nova-compute[75469]: WARNING nova.compute.manager [req-9a312121-472b-41f1-bb75-888c1447c9fa req-fea0ee7b-876d-42cd-a9ee-03c607794fc2 service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Received unexpected event network-vif-plugged-bf891eef-8760-465c-9987-402d1604700f for instance with vm_state deleted and task_state None.
Nov 14 04:58:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-9a312121-472b-41f1-bb75-888c1447c9fa req-fea0ee7b-876d-42cd-a9ee-03c607794fc2 service nova] [instance: 89b01b8e-de64-4c2f-b5f8-b717b0fd16ce] Received event network-vif-deleted-bf891eef-8760-465c-9987-402d1604700f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56c292de-6e8f-4fe2-850e-4ad8296ee1a0 tempest-VolumesNegativeTest-2114881959 tempest-VolumesNegativeTest-2114881959-project-member] Lock "89b01b8e-de64-4c2f-b5f8-b717b0fd16ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c7280e0-6117-48b8-8406-276edcc2051c {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:58:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 80741f98-11b9-4a80-a51b-39d5ce4e44f5 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid fb551839-7b5a-4ecd-b9c0-ab53addeaa45 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 929364ea-9d56-41ff-a393-8abd7df60eec {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 5c7280e0-6117-48b8-8406-276edcc2051c {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 708da3a8-c9ce-4d36-87f4-658756b11481 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 00eaa54c-e711-4c19-adbe-ed90dcc46293 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "929364ea-9d56-41ff-a393-8abd7df60eec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "5c7280e0-6117-48b8-8406-276edcc2051c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "708da3a8-c9ce-4d36-87f4-658756b11481" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "00eaa54c-e711-4c19-adbe-ed90dcc46293" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "929364ea-9d56-41ff-a393-8abd7df60eec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-beb66011-1f35-485e-bd6d-97ee2390eaed req-cbdf6fd1-31d2-4ed4-b86a-2bd1d0f7eff4 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-changed-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-beb66011-1f35-485e-bd6d-97ee2390eaed req-cbdf6fd1-31d2-4ed4-b86a-2bd1d0f7eff4 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Refreshing instance network info cache due to event network-changed-bf280bdb-b07e-4472-b87a-304b48127d7c. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-beb66011-1f35-485e-bd6d-97ee2390eaed req-cbdf6fd1-31d2-4ed4-b86a-2bd1d0f7eff4 service nova] Acquiring lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-beb66011-1f35-485e-bd6d-97ee2390eaed req-cbdf6fd1-31d2-4ed4-b86a-2bd1d0f7eff4 service nova] Acquired lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:58:45 user nova-compute[75469]: DEBUG nova.network.neutron [req-beb66011-1f35-485e-bd6d-97ee2390eaed req-cbdf6fd1-31d2-4ed4-b86a-2bd1d0f7eff4 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Refreshing network info cache for port bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:58:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:46 user nova-compute[75469]: DEBUG nova.network.neutron [req-beb66011-1f35-485e-bd6d-97ee2390eaed req-cbdf6fd1-31d2-4ed4-b86a-2bd1d0f7eff4 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updated VIF entry in instance network info cache for port bf280bdb-b07e-4472-b87a-304b48127d7c. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:58:46 user nova-compute[75469]: DEBUG nova.network.neutron [req-beb66011-1f35-485e-bd6d-97ee2390eaed req-cbdf6fd1-31d2-4ed4-b86a-2bd1d0f7eff4 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updating instance_info_cache with network_info: [{"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:58:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-beb66011-1f35-485e-bd6d-97ee2390eaed req-cbdf6fd1-31d2-4ed4-b86a-2bd1d0f7eff4 service nova] Releasing lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:58:47 user nova-compute[75469]: DEBUG nova.compute.manager [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:58:47 user nova-compute[75469]: INFO nova.compute.manager [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] instance snapshotting
Nov 14 04:58:47 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:58:47 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:58:47 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Beginning live snapshot process
Nov 14 04:58:47 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 04:58:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json -f qcow2 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json -f qcow2 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi04oyqrf/16bf300a3cf64dbf846aeeb67af41dc8.delta 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi04oyqrf/16bf300a3cf64dbf846aeeb67af41dc8.delta 1073741824" returned: 0 in 0.047s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:47 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 04:58:48 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:58:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:58:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:58:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:58:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:58:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 04:58:49 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 04:58:49 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 04:58:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi04oyqrf/16bf300a3cf64dbf846aeeb67af41dc8.delta /opt/stack/data/nova/instances/snapshots/tmpi04oyqrf/16bf300a3cf64dbf846aeeb67af41dc8 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi04oyqrf/16bf300a3cf64dbf846aeeb67af41dc8.delta /opt/stack/data/nova/instances/snapshots/tmpi04oyqrf/16bf300a3cf64dbf846aeeb67af41dc8" returned: 0 in 0.569s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:49 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Snapshot extracted, beginning image upload
Nov 14 04:58:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:58:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:52 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Snapshot image upload complete
Nov 14 04:58:52 user nova-compute[75469]: INFO nova.compute.manager [None req-956b9053-c0aa-464c-aabc-64c22d3fd825 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Took 5.40 seconds to snapshot the instance on the hypervisor.
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:58:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:54 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:58:54 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7669MB free_disk=25.072650909423828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fb551839-7b5a-4ecd-b9c0-ab53addeaa45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 5c7280e0-6117-48b8-8406-276edcc2051c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c0ca77d2-8353-4dfc-beed-ac479535b5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 708da3a8-c9ce-4d36-87f4-658756b11481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 00eaa54c-e711-4c19-adbe-ed90dcc46293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:58:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:58:55 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:58:55 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:58:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:58:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c7280e0-6117-48b8-8406-276edcc2051c is timed out.
Nov 14 04:58:56 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Successfully detached device vdb from instance 5c7280e0-6117-48b8-8406-276edcc2051c from the live domain config.
Nov 14 04:58:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZKVELvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:58:56 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0aa671-58b4-4682-bcd3-f368be0ed67b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:58:56 user nova-compute[75469]: No targets found.
Nov 14 04:58:56 user nova-compute[75469]: iSNS:
Nov 14 04:58:56 user nova-compute[75469]: No targets found.
Nov 14 04:58:56 user nova-compute[75469]: STATIC:
Nov 14 04:58:56 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188
Nov 14 04:58:56 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:58:56 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:58:56 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab
Nov 14 04:58:56 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:58:56 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:58:56 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 04:58:56 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:58:56 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:58:56 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef
Nov 14 04:58:56 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:58:56 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:58:56 user nova-compute[75469]: FIRMWARE:
Nov 14 04:58:56 user nova-compute[75469]: No targets found.
Nov 14 04:58:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:58:56 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:58:56 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee25403-3268-40b4-bae4-583c3fff7564]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e663995f-8fed-4a89-a2eb-cb7a3bda8c65]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:56 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:56 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:58:56 user nova-compute[75469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab (non-flash)
Nov 14 04:58:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:56 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:56 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:58:56 user nova-compute[75469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab (non-flash)
Nov 14 04:58:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa74c10af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab'): ({'sdd'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Removing single pathed devices sdd {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b79f46-11d3-4fde-b6c6-4bdce637c36f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc5a85a-c5f3-4ea5-babd-19a0db4f8fb5]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Flushing IO for device /dev/sdd {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[188d982d-5d48-4ed0-af23-6d9979d50f39]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd06b97-3997-47d2-8258-3842ca3264f0]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[773f6643-1f39-407d-95cf-59ca3a31dfdb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb50a2bb-c0c1-4485-9906-f4bdd4a8f261]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab, portal: 172.16.0.220,3260]
Nov 14 04:58:56 user nova-compute[75469]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab, portal: 172.16.0.220,3260] successful.
Nov 14 04:58:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32a386c-428d-498d-aa4e-a46615fd199e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] <== disconnect_volume: return (339ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:58:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG nova.objects.instance [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lazy-loading 'flavor' on Instance uuid 5c7280e0-6117-48b8-8406-276edcc2051c {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-32838795-bd44-4cf6-82c9-a4295da11ea6 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.706s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.586s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:57 user nova-compute[75469]: INFO nova.compute.manager [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Terminating instance
Nov 14 04:58:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-04d7084e-5bd3-4f59-bb7a-56a229165d6c req-2ca5d41a-e111-4e2f-ad88-9d8d3e0248cb service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Received event network-vif-unplugged-237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-04d7084e-5bd3-4f59-bb7a-56a229165d6c req-2ca5d41a-e111-4e2f-ad88-9d8d3e0248cb service nova] Acquiring lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-04d7084e-5bd3-4f59-bb7a-56a229165d6c req-2ca5d41a-e111-4e2f-ad88-9d8d3e0248cb service nova] Lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-04d7084e-5bd3-4f59-bb7a-56a229165d6c req-2ca5d41a-e111-4e2f-ad88-9d8d3e0248cb service nova] Lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-04d7084e-5bd3-4f59-bb7a-56a229165d6c req-2ca5d41a-e111-4e2f-ad88-9d8d3e0248cb service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] No waiting events found dispatching network-vif-unplugged-237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-04d7084e-5bd3-4f59-bb7a-56a229165d6c req-2ca5d41a-e111-4e2f-ad88-9d8d3e0248cb service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Received event network-vif-unplugged-237bd97e-c773-4221-a0e0-ce00162f3336 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:58:58 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Instance destroyed successfully.
Nov 14 04:58:58 user nova-compute[75469]: DEBUG nova.objects.instance [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lazy-loading 'resources' on Instance uuid 5c7280e0-6117-48b8-8406-276edcc2051c {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-420644135',display_name='tempest-VolumesSnapshotTestJSON-instance-420644135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-420644135',id=16,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGnvH2zrKhCFrJIq/tttnlBM4HTNP6IdMdMORMOWH4pDYlbK17TQH7DO+hPA8D8/BGT40AkPIo6V2zSHOHqlH/i8ePharzhkObWjAJz7lDAbLHbtAs9L7HC/j4JmuhbSw==',key_name='tempest-keypair-1050647762',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:56:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='600ea2b5d6174cd2a3a71944f907e59a',ramdisk_id='',reservation_id='r-u2hkzjmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-16916651',owner_user_name='tempest-VolumesSnapshotTestJSON-16916651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30db3f3e090c47d4815bcdc14582ed14',uuid=5c7280e0-6117-48b8-8406-276edcc2051c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "237bd97e-c773-4221-a0e0-ce00162f3336", "address": "fa:16:3e:9c:01:59", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237bd97e-c7", "ovs_interfaceid": "237bd97e-c773-4221-a0e0-ce00162f3336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converting VIF {"id": "237bd97e-c773-4221-a0e0-ce00162f3336", "address": "fa:16:3e:9c:01:59", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap237bd97e-c7", "ovs_interfaceid": "237bd97e-c773-4221-a0e0-ce00162f3336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:01:59,bridge_name='br-int',has_traffic_filtering=True,id=237bd97e-c773-4221-a0e0-ce00162f3336,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237bd97e-c7') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_vif [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:01:59,bridge_name='br-int',has_traffic_filtering=True,id=237bd97e-c773-4221-a0e0-ce00162f3336,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237bd97e-c7') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap237bd97e-c7, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=130c63d7-c771-4092-8198-1d68f31a36d4) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:58 user nova-compute[75469]: INFO os_vif [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:01:59,bridge_name='br-int',has_traffic_filtering=True,id=237bd97e-c773-4221-a0e0-ce00162f3336,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap237bd97e-c7')
Nov 14 04:58:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZKVELvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:58:58 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[596c6138-1110-460c-9112-40d7220eab91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:58:58 user nova-compute[75469]: No targets found.
Nov 14 04:58:58 user nova-compute[75469]: iSNS:
Nov 14 04:58:58 user nova-compute[75469]: No targets found.
Nov 14 04:58:58 user nova-compute[75469]: STATIC:
Nov 14 04:58:58 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188
Nov 14 04:58:58 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:58:58 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:58:58 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 04:58:58 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:58:58 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:58:58 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef
Nov 14 04:58:58 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:58:58 user nova-compute[75469]:                 Iface Name: default
Nov 14 04:58:58 user nova-compute[75469]: FIRMWARE:
Nov 14 04:58:58 user nova-compute[75469]: No targets found.
Nov 14 04:58:58 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:58:58 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:58:58 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d166e318-544b-4cca-aca5-538763cd0dab', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdcfac4-2861-49a8-add6-b357108d1c08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02430ef-5a22-4d87-ad75-7bb75ee76725]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:58 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:58 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:58:58 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:58:58 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:58:58 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:58:58 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa74c3c0280>, {}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Disconnecting from: [] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] <== disconnect_volume: return (82ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:58:58 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Deleting instance files /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c_del
Nov 14 04:58:58 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Deletion of /opt/stack/data/nova/instances/5c7280e0-6117-48b8-8406-276edcc2051c_del complete
Nov 14 04:58:58 user nova-compute[75469]: INFO nova.compute.manager [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 04:58:58 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:58:58 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:58:59 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:58:59 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Took 0.97 seconds to deallocate network for instance.
Nov 14 04:58:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-babc95a1-4644-4f6a-91bf-5229cc531e9d req-8499369e-ba5c-4f37-8b24-8f0aef3af1e2 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Received event network-vif-deleted-237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:59 user nova-compute[75469]: WARNING nova.volume.cinder [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Attachment 7f71f931-4540-4c5a-9dc6-67ef615f5e09 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7f71f931-4540-4c5a-9dc6-67ef615f5e09. (HTTP 404) (Request-ID: req-68998823-9ef1-4a10-9c84-65017b5971a9)
Nov 14 04:58:59 user nova-compute[75469]: INFO nova.compute.manager [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 04:58:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:58:59 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:58:59 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:58:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:59 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Deleted allocations for instance 5c7280e0-6117-48b8-8406-276edcc2051c
Nov 14 04:58:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-60865c41-d6bd-41cc-9a7b-eac86f2c0511 req-737a4e7f-3000-4e89-a2d8-34932b3be7b7 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Received event network-vif-plugged-237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:58:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-60865c41-d6bd-41cc-9a7b-eac86f2c0511 req-737a4e7f-3000-4e89-a2d8-34932b3be7b7 service nova] Acquiring lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:58:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-60865c41-d6bd-41cc-9a7b-eac86f2c0511 req-737a4e7f-3000-4e89-a2d8-34932b3be7b7 service nova] Lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-60865c41-d6bd-41cc-9a7b-eac86f2c0511 req-737a4e7f-3000-4e89-a2d8-34932b3be7b7 service nova] Lock "5c7280e0-6117-48b8-8406-276edcc2051c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-60865c41-d6bd-41cc-9a7b-eac86f2c0511 req-737a4e7f-3000-4e89-a2d8-34932b3be7b7 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] No waiting events found dispatching network-vif-plugged-237bd97e-c773-4221-a0e0-ce00162f3336 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:58:59 user nova-compute[75469]: WARNING nova.compute.manager [req-60865c41-d6bd-41cc-9a7b-eac86f2c0511 req-737a4e7f-3000-4e89-a2d8-34932b3be7b7 service nova] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] Received unexpected event network-vif-plugged-237bd97e-c773-4221-a0e0-ce00162f3336 for instance with vm_state deleted and task_state None.
Nov 14 04:58:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-713fdb8d-3e8f-4db6-b2d4-23fe7c731298 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.421s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:58:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.366s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:58:59 user nova-compute[75469]: INFO nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 5c7280e0-6117-48b8-8406-276edcc2051c] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 14 04:58:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "5c7280e0-6117-48b8-8406-276edcc2051c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:59:16 user nova-compute[75469]: INFO nova.compute.claims [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Claim successful on node user
Nov 14 04:59:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:59:16 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:59:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:59:16 user nova-compute[75469]: INFO nova.virt.block_device [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Booting with volume 245e075c-01ef-422e-8692-10286c8c8869 at /dev/vda
Nov 14 04:59:16 user nova-compute[75469]: DEBUG os_brick.utils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b10e2-c646-4377-91fc-bb48695b4a0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[58be42c4-485c-4fe2-9236-402f09c76643]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff47a4fe-a08d-4b68-bf27-85e05c82db1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3663a8b9-83cf-4770-b178-994248b37f85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:59:16 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:59:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d34fea-e2c0-4774-bc00-abe0e2788164]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG os_brick.utils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating existing volume attachment record: 62eaa8dc-c47c-444a-9497-2457489f0284 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:59:16 user nova-compute[75469]: DEBUG nova.policy [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61868d69adcb4fa88dee243a3c7ebd5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cd39bf8e024388913a7ec12bd911f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:59:17 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully created port: ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:59:18 user nova-compute[75469]: INFO nova.compute.claims [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Claim successful on node user
Nov 14 04:59:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully created port: 15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:59:18 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:59:18 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Creating image(s)
Nov 14 04:59:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "/opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "/opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:18 user nova-compute[75469]: DEBUG nova.policy [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88fb3641cda04c96b925d7b83af359b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fb1cdf42b04f37b025ed7385c4af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully created port: 78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk 1073741824" returned: 0 in 0.046s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Cannot resize image /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Ensure instance console log exists: /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:20 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully created port: cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:59:20 user nova-compute[75469]: DEBUG nova.network.neutron [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Successfully created port: c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully created port: 6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:59:21 user nova-compute[75469]: INFO nova.virt.block_device [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Booting with volume e65207ba-20f7-4da4-b9f0-1d37051252f8 at /dev/vdb
Nov 14 04:59:21 user nova-compute[75469]: DEBUG os_brick.utils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec15e291-56b1-4399-b410-d0dea3cc51e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[271481f6-0e9b-41bf-a2e5-e78b9783fde6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[225189af-44b0-49d5-a162-c54e29de4456]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fb0d41-4b28-4f92-8c44-ee567c8d7c4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Successfully updated port: c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:59:21 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5499fe15-8040-4ab0-9f71-00280f11723a]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG os_brick.utils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating existing volume attachment record: c98a183e-1a50-4615-94a6-ad99c70c6747 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquired lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-77c41f1c-12ff-4832-b33e-13d00c064d42 req-c25aa146-caee-40c2-8961-83af982ea3e9 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-changed-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-77c41f1c-12ff-4832-b33e-13d00c064d42 req-c25aa146-caee-40c2-8961-83af982ea3e9 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Refreshing instance network info cache due to event network-changed-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-77c41f1c-12ff-4832-b33e-13d00c064d42 req-c25aa146-caee-40c2-8961-83af982ea3e9 service nova] Acquiring lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updating instance_info_cache with network_info: [{"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Releasing lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Instance network_info: |[{"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-77c41f1c-12ff-4832-b33e-13d00c064d42 req-c25aa146-caee-40c2-8961-83af982ea3e9 service nova] Acquired lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.network.neutron [req-77c41f1c-12ff-4832-b33e-13d00c064d42 req-c25aa146-caee-40c2-8961-83af982ea3e9 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Refreshing network info cache for port c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Start _get_guest_xml network_info=[{"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:59:22 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:59:22 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:59:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-365164676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-365164676',id=22,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSQD5bSfa6qdQEhwI0KK41rmx99sGIX2msv5MKh6/gRf59kjIsdfgHdVcu1dd5V/7yhtWKba787Gpp7+nUIS8kVdxt6A0/wjwfuOwzT00jhB6IpMWMYgl0xCInO61eY4g==',key_name='tempest-keypair-757025621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-a50r03tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=ff1ee641-8abc-4e0e-acfe-b48859a428da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.objects.instance [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'pci_devices' on Instance uuid ff1ee641-8abc-4e0e-acfe-b48859a428da {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:59:22 user nova-compute[75469]:   <uuid>ff1ee641-8abc-4e0e-acfe-b48859a428da</uuid>
Nov 14 04:59:22 user nova-compute[75469]:   <name>instance-00000016</name>
Nov 14 04:59:22 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:59:22 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:59:22 user nova-compute[75469]:   <metadata>
Nov 14 04:59:22 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:59:22 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:59:22 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-365164676</nova:name>
Nov 14 04:59:22 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:59:22</nova:creationTime>
Nov 14 04:59:22 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:59:22 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:59:22 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:59:22 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:59:22 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:59:22 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:59:22 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:59:22 user nova-compute[75469]:       <nova:owner>
Nov 14 04:59:22 user nova-compute[75469]:         <nova:user uuid="88fb3641cda04c96b925d7b83af359b6">tempest-AttachVolumeShelveTestJSON-41564664-project-member</nova:user>
Nov 14 04:59:22 user nova-compute[75469]:         <nova:project uuid="95fb1cdf42b04f37b025ed7385c4af37">tempest-AttachVolumeShelveTestJSON-41564664</nova:project>
Nov 14 04:59:22 user nova-compute[75469]:       </nova:owner>
Nov 14 04:59:22 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:59:22 user nova-compute[75469]:       <nova:ports>
Nov 14 04:59:22 user nova-compute[75469]:         <nova:port uuid="c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6">
Nov 14 04:59:22 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 04:59:22 user nova-compute[75469]:         </nova:port>
Nov 14 04:59:22 user nova-compute[75469]:       </nova:ports>
Nov 14 04:59:22 user nova-compute[75469]:     </nova:instance>
Nov 14 04:59:22 user nova-compute[75469]:   </metadata>
Nov 14 04:59:22 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:59:22 user nova-compute[75469]:     <system>
Nov 14 04:59:22 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:59:22 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:59:22 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:59:22 user nova-compute[75469]:       <entry name="serial">ff1ee641-8abc-4e0e-acfe-b48859a428da</entry>
Nov 14 04:59:22 user nova-compute[75469]:       <entry name="uuid">ff1ee641-8abc-4e0e-acfe-b48859a428da</entry>
Nov 14 04:59:22 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:59:22 user nova-compute[75469]:     </system>
Nov 14 04:59:22 user nova-compute[75469]:   </sysinfo>
Nov 14 04:59:22 user nova-compute[75469]:   <os>
Nov 14 04:59:22 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:59:22 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:59:22 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:59:22 user nova-compute[75469]:   </os>
Nov 14 04:59:22 user nova-compute[75469]:   <features>
Nov 14 04:59:22 user nova-compute[75469]:     <acpi/>
Nov 14 04:59:22 user nova-compute[75469]:     <apic/>
Nov 14 04:59:22 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:59:22 user nova-compute[75469]:   </features>
Nov 14 04:59:22 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:59:22 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:59:22 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:59:22 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:59:22 user nova-compute[75469]:   </clock>
Nov 14 04:59:22 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:59:22 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:59:22 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:59:22 user nova-compute[75469]:   </cpu>
Nov 14 04:59:22 user nova-compute[75469]:   <devices>
Nov 14 04:59:22 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:59:22 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:59:22 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk"/>
Nov 14 04:59:22 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:59:22 user nova-compute[75469]:     </disk>
Nov 14 04:59:22 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:59:22 user nova-compute[75469]:       <mac address="fa:16:3e:f5:7d:1b"/>
Nov 14 04:59:22 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:22 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:59:22 user nova-compute[75469]:       <target dev="tapc3e0b05c-1e"/>
Nov 14 04:59:22 user nova-compute[75469]:     </interface>
Nov 14 04:59:22 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:59:22 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/console.log" append="off"/>
Nov 14 04:59:22 user nova-compute[75469]:     </serial>
Nov 14 04:59:22 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:59:22 user nova-compute[75469]:     <video>
Nov 14 04:59:22 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:22 user nova-compute[75469]:     </video>
Nov 14 04:59:22 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:59:22 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:59:22 user nova-compute[75469]:     </rng>
Nov 14 04:59:22 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:59:22 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:59:22 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:59:22 user nova-compute[75469]:     </memballoon>
Nov 14 04:59:22 user nova-compute[75469]:   </devices>
Nov 14 04:59:22 user nova-compute[75469]: </domain>
Nov 14 04:59:22 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:59:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-365164676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-365164676',id=22,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSQD5bSfa6qdQEhwI0KK41rmx99sGIX2msv5MKh6/gRf59kjIsdfgHdVcu1dd5V/7yhtWKba787Gpp7+nUIS8kVdxt6A0/wjwfuOwzT00jhB6IpMWMYgl0xCInO61eY4g==',key_name='tempest-keypair-757025621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-a50r03tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=ff1ee641-8abc-4e0e-acfe-b48859a428da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG os_vif [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27694c5c-a9b1-59d5-b7e6-aad9d2cbc052', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3e0b05c-1e, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3e0b05c-1e, col_values=(('qos', UUID('35b4bb5f-68bf-44ed-b928-58ce93ccc467')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3e0b05c-1e, col_values=(('external_ids', {'iface-id': 'c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:7d:1b', 'vm-uuid': 'ff1ee641-8abc-4e0e-acfe-b48859a428da'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:22 user nova-compute[75469]: INFO os_vif [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e')
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] No VIF found with MAC fa:16:3e:f5:7d:1b, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:59:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully updated port: ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-77c41f1c-12ff-4832-b33e-13d00c064d42 req-c25aa146-caee-40c2-8961-83af982ea3e9 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updated VIF entry in instance network info cache for port c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-77c41f1c-12ff-4832-b33e-13d00c064d42 req-c25aa146-caee-40c2-8961-83af982ea3e9 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updating instance_info_cache with network_info: [{"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-77c41f1c-12ff-4832-b33e-13d00c064d42 req-c25aa146-caee-40c2-8961-83af982ea3e9 service nova] Releasing lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully updated port: 04007ea0-4889-41fc-9716-05d8b8889b8b {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-a98f58b7-f60a-45bb-9d00-8306d284afc8 req-1f26eb4c-1009-412b-ab77-142de32a47ed service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-changed-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-a98f58b7-f60a-45bb-9d00-8306d284afc8 req-1f26eb4c-1009-412b-ab77-142de32a47ed service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing instance network info cache due to event network-changed-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a98f58b7-f60a-45bb-9d00-8306d284afc8 req-1f26eb4c-1009-412b-ab77-142de32a47ed service nova] Acquiring lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a98f58b7-f60a-45bb-9d00-8306d284afc8 req-1f26eb4c-1009-412b-ab77-142de32a47ed service nova] Acquired lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-a98f58b7-f60a-45bb-9d00-8306d284afc8 req-1f26eb4c-1009-412b-ab77-142de32a47ed service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing network info cache for port ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-a98f58b7-f60a-45bb-9d00-8306d284afc8 req-1f26eb4c-1009-412b-ab77-142de32a47ed service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:59:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-4659a714-6583-4963-8c42-96e9187ae887 req-2b720343-b4d1-4361-b367-995dcf46e338 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4659a714-6583-4963-8c42-96e9187ae887 req-2b720343-b4d1-4361-b367-995dcf46e338 service nova] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4659a714-6583-4963-8c42-96e9187ae887 req-2b720343-b4d1-4361-b367-995dcf46e338 service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4659a714-6583-4963-8c42-96e9187ae887 req-2b720343-b4d1-4361-b367-995dcf46e338 service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-4659a714-6583-4963-8c42-96e9187ae887 req-2b720343-b4d1-4361-b367-995dcf46e338 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] No waiting events found dispatching network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:24 user nova-compute[75469]: WARNING nova.compute.manager [req-4659a714-6583-4963-8c42-96e9187ae887 req-2b720343-b4d1-4361-b367-995dcf46e338 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received unexpected event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 for instance with vm_state building and task_state spawning.
Nov 14 04:59:24 user nova-compute[75469]: DEBUG nova.network.neutron [req-a98f58b7-f60a-45bb-9d00-8306d284afc8 req-1f26eb4c-1009-412b-ab77-142de32a47ed service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a98f58b7-f60a-45bb-9d00-8306d284afc8 req-1f26eb4c-1009-412b-ab77-142de32a47ed service nova] Releasing lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:24 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully updated port: 92591c00-78d2-4b18-b52d-c054eb5f2636 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:59:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:25 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully updated port: 15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:59:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-changed-04007ea0-4889-41fc-9716-05d8b8889b8b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing instance network info cache due to event network-changed-04007ea0-4889-41fc-9716-05d8b8889b8b. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:59:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] Acquiring lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] Acquired lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:25 user nova-compute[75469]: DEBUG nova.network.neutron [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing network info cache for port 04007ea0-4889-41fc-9716-05d8b8889b8b {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:59:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Instance spawned successfully.
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-c7c128c3-5a41-4330-b4f8-4a163277b7ae req-104e2aae-2987-454f-baea-24000dafae9e service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c7c128c3-5a41-4330-b4f8-4a163277b7ae req-104e2aae-2987-454f-baea-24000dafae9e service nova] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c7c128c3-5a41-4330-b4f8-4a163277b7ae req-104e2aae-2987-454f-baea-24000dafae9e service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c7c128c3-5a41-4330-b4f8-4a163277b7ae req-104e2aae-2987-454f-baea-24000dafae9e service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-c7c128c3-5a41-4330-b4f8-4a163277b7ae req-104e2aae-2987-454f-baea-24000dafae9e service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] No waiting events found dispatching network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:26 user nova-compute[75469]: WARNING nova.compute.manager [req-c7c128c3-5a41-4330-b4f8-4a163277b7ae req-104e2aae-2987-454f-baea-24000dafae9e service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received unexpected event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 for instance with vm_state building and task_state spawning.
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:26 user nova-compute[75469]: INFO nova.compute.manager [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Took 7.33 seconds to spawn the instance on the hypervisor.
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully updated port: 78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:59:26 user nova-compute[75469]: INFO nova.virt.block_device [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Booting with volume 9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 at /dev/vdc
Nov 14 04:59:26 user nova-compute[75469]: INFO nova.compute.manager [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Took 8.12 seconds to build instance.
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5dee6b69-5e9e-4187-a3c5-61b603bed029 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.261s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG os_brick.utils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0538085-8e75-4b9a-92dc-f6a378f0d39c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] Releasing lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-changed-92591c00-78d2-4b18-b52d-c054eb5f2636 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing instance network info cache due to event network-changed-92591c00-78d2-4b18-b52d-c054eb5f2636. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] Acquiring lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] Acquired lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing network info cache for port 92591c00-78d2-4b18-b52d-c054eb5f2636 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfd3d6d-99fe-45d9-8a93-e38c2b037854]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d4bea2-eaf6-4921-9a72-ef54899e5c2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e65625-3dca-45ba-b8d9-edb358d86e00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:59:26 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:59:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c607cf-6ef8-44c1-80fa-1fe3f4ad90c0]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG os_brick.utils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating existing volume attachment record: ae3199cf-871c-4f0d-bac5-0351a7d4c3fd {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:59:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] Releasing lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-changed-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing instance network info cache due to event network-changed-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] Acquiring lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] Acquired lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing network info cache for port 15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-216dd0c2-b8e9-4780-9448-d728cc3a11f4 req-781d2df5-2f57-4bff-b7a7-b627d97f4712 service nova] Releasing lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully updated port: cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-changed-78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing instance network info cache due to event network-changed-78b07ae1-d554-41be-935f-3679ac796e28. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] Acquiring lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] Acquired lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing network info cache for port 78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] Releasing lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG nova.compute.manager [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-changed-cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG nova.compute.manager [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing instance network info cache due to event network-changed-cc63a63d-99d0-4fb8-9e21-182471a8b35f. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] Acquiring lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] Acquired lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing network info cache for port cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a72dcd46-6de6-412b-bf89-a1c6b7b3e4b4 req-6a81bf18-cc87-4cb3-af0e-db423a37c1bf service nova] Releasing lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:28 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Successfully updated port: 6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:59:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquired lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:29 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:59:29 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:59:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-3f4b7f67-a501-43d9-bfb9-4c93eb21b2a3 req-15e679c9-9b72-437f-8a61-c4a44334f997 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-changed-6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-3f4b7f67-a501-43d9-bfb9-4c93eb21b2a3 req-15e679c9-9b72-437f-8a61-c4a44334f997 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing instance network info cache due to event network-changed-6f39315a-307d-4436-bdd6-fed7197dfb5e. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:59:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3f4b7f67-a501-43d9-bfb9-4c93eb21b2a3 req-15e679c9-9b72-437f-8a61-c4a44334f997 service nova] Acquiring lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [{"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78b07ae1-d554-41be-935f-3679ac796e28", "address": "fa:16:3e:b0:f4:b4", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07ae1-d5", "ovs_interfaceid": "78b07ae1-d554-41be-935f-3679ac796e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Releasing lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Instance network_info: |[{"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78b07ae1-d554-41be-935f-3679ac796e28", "address": "fa:16:3e:b0:f4:b4", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07ae1-d5", "ovs_interfaceid": "78b07ae1-d554-41be-935f-3679ac796e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3f4b7f67-a501-43d9-bfb9-4c93eb21b2a3 req-15e679c9-9b72-437f-8a61-c4a44334f997 service nova] Acquired lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.network.neutron [req-3f4b7f67-a501-43d9-bfb9-4c93eb21b2a3 req-15e679c9-9b72-437f-8a61-c4a44334f997 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing network info cache for port 6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:59:31 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Creating image(s)
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Ensure instance console log exists: /opt/stack/data/nova/instances/1c1c2492-d197-4b70-a915-1c594f49f8c1/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Start _get_guest_xml network_info=[{"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78b07ae1-d554-41be-935f-3679ac796e28", "address": "fa:16:3e:b0:f4:b4", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07ae1-d5", "ovs_interfaceid": "78b07ae1-d554-41be-935f-3679ac796e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '62eaa8dc-c47c-444a-9497-2457489f0284', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heAVNJnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c1c2492-d197-4b70-a915-1c594f49f8c1', 'attached_at': '', 'detached_at': '', 'volume_id': '245e075c-01ef-422e-8692-10286c8c8869', 'serial': '245e075c-01ef-422e-8692-10286c8c8869'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'attachment_id': 'c98a183e-1a50-4615-94a6-ad99c70c6747', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHOlwLNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c1c2492-d197-4b70-a915-1c594f49f8c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'e65207ba-20f7-4da4-b9f0-1d37051252f8', 'serial': 'e65207ba-20f7-4da4-b9f0-1d37051252f8'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'attachment_id': 'ae3199cf-871c-4f0d-bac5-0351a7d4c3fd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLxbgndM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c1c2492-d197-4b70-a915-1c594f49f8c1', 'attached_at': '', 'detached_at': '', 'volume_id': '9f10f1e7-5174-4160-a6dc-c4bbf65f93d0', 'serial': '9f10f1e7-5174-4160-a6dc-c4bbf65f93d0'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:59:31 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:59:31 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heAVNJnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:59:31 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:59:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:59:31 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:59:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:59:31 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:59:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82506310-8538-4165-ade9-e602e606de1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:59:31 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.150s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ee4fc7-0ba4-4a5d-b5a1-aba9e091b93e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869] added
Nov 14 04:59:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d48479e-4765-4d88-a689-fff26d2fe130]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d695645-e857-456c-9e1c-4bca0ffc82ac]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heAVNJnj {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heAVNJnj" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8edf3ef-17b7-4d6d-bc3a-8cb54bf8ea50]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG nova.network.neutron [req-3f4b7f67-a501-43d9-bfb9-4c93eb21b2a3 req-15e679c9-9b72-437f-8a61-c4a44334f997 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updated VIF entry in instance network info cache for port 6f39315a-307d-4436-bdd6-fed7197dfb5e. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG nova.network.neutron [req-3f4b7f67-a501-43d9-bfb9-4c93eb21b2a3 req-15e679c9-9b72-437f-8a61-c4a44334f997 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [{"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78b07ae1-d554-41be-935f-3679ac796e28", "address": "fa:16:3e:b0:f4:b4", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07ae1-d5", "ovs_interfaceid": "78b07ae1-d554-41be-935f-3679ac796e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'heAVNJnj'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3f4b7f67-a501-43d9-bfb9-4c93eb21b2a3 req-15e679c9-9b72-437f-8a61-c4a44334f997 service nova] Releasing lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d723ea1-f0e0-4409-b544-65341b68c363]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cc3341-9522-45a4-a6d9-e26cc428d9de]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:32 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:32 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:32 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:32 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbc9324-637e-4334-b9f0-6241e4a4eeab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869, portal: 172.16.0.220,3260]
Nov 14 04:59:32 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869, portal: 172.16.0.220,3260] successful.
Nov 14 04:59:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2096c5-91f9-43f1-aa21-27eea80a3972]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e19bc4-2aeb-44d4-8652-7373fa2fece1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:32 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:32 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:32 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 04:59:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:32 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:32 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:32 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 04:59:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.476s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1932cc-9e78-4fe3-b3ff-a5262564c16d]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heAVNJnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:59:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.528s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] <== connect_volume: return (1529ms) {'type': 'block', 'scsi_wwn': '23133376438643636', 'path': '/dev/sdd'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133376438643636', 'path': '/dev/sdd'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHOlwLNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:59:33 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:59:33 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:59:33 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5add7617-d88e-497c-9c49-308d2e3a6e46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:59:33 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e0351a-6ae6-4535-bd30-e6f69af9d077]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8] added
Nov 14 04:59:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb00f768-252b-4af4-8bf5-7aaf2f4d288a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb74c34f-2393-4b84-b274-621c8c6e4dcf]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YHOlwLNM {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YHOlwLNM" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[55723f39-d2e3-4013-94ce-08c6e7f6974b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YHOlwLNM'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5438f7b3-8a82-480f-bd70-8cec779d3300]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f213085-9dd0-4ea2-a4ba-5ed69bc1dca8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[353ac4ca-323f-443b-ab34-ed4e73b372ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8, portal: 172.16.0.220,3260]
Nov 14 04:59:33 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8, portal: 172.16.0.220,3260] successful.
Nov 14 04:59:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f49053b-8b05-417b-ba72-0089fffc1dc7]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab4e296-a58a-4b57-9453-c6eaac784fec]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 04:59:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[02795531-2b04-4669-96f7-6730ea62cd89]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:59:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHOlwLNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26530663266306236', 'path': '/dev/sdf'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530663266306236', 'path': '/dev/sdf'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLxbgndM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:59:34 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:59:34 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:59:34 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[23857ca7-42f7-48b3-93c0-6b965100a97b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:59:34 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[276adb76-539c-4c31-895f-747654d1d83f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0] added
Nov 14 04:59:34 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ab6bf7-ad2f-45f2-a636-66f0aacd5dd1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa838177-db25-4d67-8a79-93835556a893]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLxbgndM {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLxbgndM" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f13f63-9867-4404-aff7-bcf6b119d9ab]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CLxbgndM'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae88c673-59ab-4f42-ad0c-0e8eba655648]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b4afe6-b3c0-4da0-acc0-606409ff9c23]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f13640c-fa95-48b9-94b9-c0680bc008e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0, portal: 172.16.0.220,3260]
Nov 14 04:59:35 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0, portal: 172.16.0.220,3260] successful.
Nov 14 04:59:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7425697-7603-44b4-8ffc-f58f86cf8c46]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d6f342-e107-4736-b9e1-9d4e2f789a27]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 04:59:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf065b5-d084-4cf6-98cf-898973adf961]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLxbgndM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:35 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:59:36 user nova-compute[75469]: INFO nova.compute.claims [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Claim successful on node user
Nov 14 04:59:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26534633962356138', 'path': '/dev/sdg'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534633962356138', 'path': '/dev/sdg'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:9b:df,bridge_name='br-int',has_traffic_filtering=True,id=ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2,network=Network(58e00b8d-9e28-481c-9034-2d799599ac92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8439ae-cc') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:96:29,bridge_name='br-int',has_traffic_filtering=True,id=04007ea0-4889-41fc-9716-05d8b8889b8b,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04007ea0-48') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:c4:4d,bridge_name='br-int',has_traffic_filtering=True,id=92591c00-78d2-4b18-b52d-c054eb5f2636,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92591c00-78') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=15a53d99-f268-49f0-8ffb-14f1dbfc5a3a,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a53d99-f2') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78b07ae1-d554-41be-935f-3679ac796e28", "address": "fa:16:3e:b0:f4:b4", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07ae1-d5", "ovs_interfaceid": "78b07ae1-d554-41be-935f-3679ac796e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "78b07ae1-d554-41be-935f-3679ac796e28", "address": "fa:16:3e:b0:f4:b4", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07ae1-d5", "ovs_interfaceid": "78b07ae1-d554-41be-935f-3679ac796e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=78b07ae1-d554-41be-935f-3679ac796e28,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07ae1-d5') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f4:62,bridge_name='br-int',has_traffic_filtering=True,id=cc63a63d-99d0-4fb8-9e21-182471a8b35f,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc63a63d-99') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f39315a-307d-4436-bdd6-fed7197dfb5e,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39315a-30') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.objects.instance [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c1c2492-d197-4b70-a915-1c594f49f8c1 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:59:36 user nova-compute[75469]:   <uuid>1c1c2492-d197-4b70-a915-1c594f49f8c1</uuid>
Nov 14 04:59:36 user nova-compute[75469]:   <name>instance-00000015</name>
Nov 14 04:59:36 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:59:36 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:59:36 user nova-compute[75469]:   <metadata>
Nov 14 04:59:36 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:59:36 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:59:36 user nova-compute[75469]:       <nova:name>tempest-device-tagging-server-1365694530</nova:name>
Nov 14 04:59:36 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:59:31</nova:creationTime>
Nov 14 04:59:36 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:59:36 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:59:36 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:59:36 user nova-compute[75469]:       <nova:owner>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:user uuid="61868d69adcb4fa88dee243a3c7ebd5e">tempest-TaggedBootDevicesTest-1408161910-project-member</nova:user>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:project uuid="70cd39bf8e024388913a7ec12bd911f7">tempest-TaggedBootDevicesTest-1408161910</nova:project>
Nov 14 04:59:36 user nova-compute[75469]:       </nova:owner>
Nov 14 04:59:36 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:59:36 user nova-compute[75469]:       <nova:ports>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:port uuid="ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2">
Nov 14 04:59:36 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 04:59:36 user nova-compute[75469]:         </nova:port>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:port uuid="04007ea0-4889-41fc-9716-05d8b8889b8b">
Nov 14 04:59:36 user nova-compute[75469]:           <nova:ip type="fixed" address="10.1.1.160" ipVersion="4"/>
Nov 14 04:59:36 user nova-compute[75469]:         </nova:port>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:port uuid="92591c00-78d2-4b18-b52d-c054eb5f2636">
Nov 14 04:59:36 user nova-compute[75469]:           <nova:ip type="fixed" address="10.1.1.109" ipVersion="4"/>
Nov 14 04:59:36 user nova-compute[75469]:         </nova:port>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:port uuid="15a53d99-f268-49f0-8ffb-14f1dbfc5a3a">
Nov 14 04:59:36 user nova-compute[75469]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Nov 14 04:59:36 user nova-compute[75469]:         </nova:port>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:port uuid="78b07ae1-d554-41be-935f-3679ac796e28">
Nov 14 04:59:36 user nova-compute[75469]:           <nova:ip type="fixed" address="10.1.1.148" ipVersion="4"/>
Nov 14 04:59:36 user nova-compute[75469]:         </nova:port>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:port uuid="cc63a63d-99d0-4fb8-9e21-182471a8b35f">
Nov 14 04:59:36 user nova-compute[75469]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 04:59:36 user nova-compute[75469]:         </nova:port>
Nov 14 04:59:36 user nova-compute[75469]:         <nova:port uuid="6f39315a-307d-4436-bdd6-fed7197dfb5e">
Nov 14 04:59:36 user nova-compute[75469]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 04:59:36 user nova-compute[75469]:         </nova:port>
Nov 14 04:59:36 user nova-compute[75469]:       </nova:ports>
Nov 14 04:59:36 user nova-compute[75469]:     </nova:instance>
Nov 14 04:59:36 user nova-compute[75469]:   </metadata>
Nov 14 04:59:36 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:59:36 user nova-compute[75469]:     <system>
Nov 14 04:59:36 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:59:36 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:59:36 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:59:36 user nova-compute[75469]:       <entry name="serial">1c1c2492-d197-4b70-a915-1c594f49f8c1</entry>
Nov 14 04:59:36 user nova-compute[75469]:       <entry name="uuid">1c1c2492-d197-4b70-a915-1c594f49f8c1</entry>
Nov 14 04:59:36 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:59:36 user nova-compute[75469]:     </system>
Nov 14 04:59:36 user nova-compute[75469]:   </sysinfo>
Nov 14 04:59:36 user nova-compute[75469]:   <os>
Nov 14 04:59:36 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:59:36 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:59:36 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:59:36 user nova-compute[75469]:   </os>
Nov 14 04:59:36 user nova-compute[75469]:   <features>
Nov 14 04:59:36 user nova-compute[75469]:     <acpi/>
Nov 14 04:59:36 user nova-compute[75469]:     <apic/>
Nov 14 04:59:36 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:59:36 user nova-compute[75469]:   </features>
Nov 14 04:59:36 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:59:36 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:59:36 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:59:36 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:59:36 user nova-compute[75469]:   </clock>
Nov 14 04:59:36 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:59:36 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:59:36 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:59:36 user nova-compute[75469]:   </cpu>
Nov 14 04:59:36 user nova-compute[75469]:   <devices>
Nov 14 04:59:36 user nova-compute[75469]:     <disk type="file" device="cdrom">
Nov 14 04:59:36 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 04:59:36 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/1c1c2492-d197-4b70-a915-1c594f49f8c1/disk.config"/>
Nov 14 04:59:36 user nova-compute[75469]:       <target dev="hda" bus="ide"/>
Nov 14 04:59:36 user nova-compute[75469]:     </disk>
Nov 14 04:59:36 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:59:36 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:59:36 user nova-compute[75469]:       <source dev="/dev/sdd"/>
Nov 14 04:59:36 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:59:36 user nova-compute[75469]:       <serial>245e075c-01ef-422e-8692-10286c8c8869</serial>
Nov 14 04:59:36 user nova-compute[75469]:     </disk>
Nov 14 04:59:36 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:59:36 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:59:36 user nova-compute[75469]:       <source dev="/dev/sdf"/>
Nov 14 04:59:36 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 04:59:36 user nova-compute[75469]:       <serial>e65207ba-20f7-4da4-b9f0-1d37051252f8</serial>
Nov 14 04:59:36 user nova-compute[75469]:     </disk>
Nov 14 04:59:36 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 04:59:36 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:59:36 user nova-compute[75469]:       <source dev="/dev/sdg"/>
Nov 14 04:59:36 user nova-compute[75469]:       <target dev="vdc" bus="virtio"/>
Nov 14 04:59:36 user nova-compute[75469]:       <serial>9f10f1e7-5174-4160-a6dc-c4bbf65f93d0</serial>
Nov 14 04:59:36 user nova-compute[75469]:     </disk>
Nov 14 04:59:36 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:59:36 user nova-compute[75469]:       <mac address="fa:16:3e:d3:9b:df"/>
Nov 14 04:59:36 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:36 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:59:36 user nova-compute[75469]:       <target dev="tapba8439ae-cc"/>
Nov 14 04:59:36 user nova-compute[75469]:     </interface>
Nov 14 04:59:36 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:59:36 user nova-compute[75469]:       <mac address="fa:16:3e:f1:96:29"/>
Nov 14 04:59:36 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:36 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:59:36 user nova-compute[75469]:       <target dev="tap04007ea0-48"/>
Nov 14 04:59:36 user nova-compute[75469]:     </interface>
Nov 14 04:59:36 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:59:36 user nova-compute[75469]:       <mac address="fa:16:3e:01:c4:4d"/>
Nov 14 04:59:36 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:36 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:59:36 user nova-compute[75469]:       <target dev="tap92591c00-78"/>
Nov 14 04:59:36 user nova-compute[75469]:     </interface>
Nov 14 04:59:36 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:59:36 user nova-compute[75469]:       <mac address="fa:16:3e:2b:7b:a1"/>
Nov 14 04:59:36 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:36 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:59:36 user nova-compute[75469]:       <target dev="tap15a53d99-f2"/>
Nov 14 04:59:36 user nova-compute[75469]:     </interface>
Nov 14 04:59:36 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:59:36 user nova-compute[75469]:       <mac address="fa:16:3e:b0:f4:b4"/>
Nov 14 04:59:36 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:36 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:59:36 user nova-compute[75469]:       <target dev="tap78b07ae1-d5"/>
Nov 14 04:59:36 user nova-compute[75469]:     </interface>
Nov 14 04:59:36 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:59:36 user nova-compute[75469]:       <mac address="fa:16:3e:f2:f4:62"/>
Nov 14 04:59:36 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:36 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:59:36 user nova-compute[75469]:       <target dev="tapcc63a63d-99"/>
Nov 14 04:59:36 user nova-compute[75469]:     </interface>
Nov 14 04:59:36 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:59:36 user nova-compute[75469]:       <mac address="fa:16:3e:51:45:ef"/>
Nov 14 04:59:36 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:36 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:59:36 user nova-compute[75469]:       <target dev="tap6f39315a-30"/>
Nov 14 04:59:36 user nova-compute[75469]:     </interface>
Nov 14 04:59:36 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:59:36 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/1c1c2492-d197-4b70-a915-1c594f49f8c1/console.log" append="off"/>
Nov 14 04:59:36 user nova-compute[75469]:     </serial>
Nov 14 04:59:36 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:59:36 user nova-compute[75469]:     <video>
Nov 14 04:59:36 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:36 user nova-compute[75469]:     </video>
Nov 14 04:59:36 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:59:36 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:59:36 user nova-compute[75469]:     </rng>
Nov 14 04:59:36 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:59:36 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:59:36 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:59:36 user nova-compute[75469]:     </memballoon>
Nov 14 04:59:36 user nova-compute[75469]:   </devices>
Nov 14 04:59:36 user nova-compute[75469]: </domain>
Nov 14 04:59:36 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:9b:df,bridge_name='br-int',has_traffic_filtering=True,id=ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2,network=Network(58e00b8d-9e28-481c-9034-2d799599ac92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8439ae-cc') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:9b:df,bridge_name='br-int',has_traffic_filtering=True,id=ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2,network=Network(58e00b8d-9e28-481c-9034-2d799599ac92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8439ae-cc') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66fd2192-48f7-5bc5-881f-88b9f74857ea', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba8439ae-cc, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba8439ae-cc, col_values=(('qos', UUID('14092f25-5124-4556-8c04-2caf6d8dcd46')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba8439ae-cc, col_values=(('external_ids', {'iface-id': 'ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:9b:df', 'vm-uuid': '1c1c2492-d197-4b70-a915-1c594f49f8c1'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: INFO os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:9b:df,bridge_name='br-int',has_traffic_filtering=True,id=ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2,network=Network(58e00b8d-9e28-481c-9034-2d799599ac92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8439ae-cc')
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:96:29,bridge_name='br-int',has_traffic_filtering=True,id=04007ea0-4889-41fc-9716-05d8b8889b8b,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04007ea0-48') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:96:29,bridge_name='br-int',has_traffic_filtering=True,id=04007ea0-4889-41fc-9716-05d8b8889b8b,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04007ea0-48') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2de4d9e-82e3-5e99-b0af-f3fdab7cd669', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04007ea0-48, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04007ea0-48, col_values=(('qos', UUID('97b2d8c3-435b-4d74-bd76-e6284cddc943')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04007ea0-48, col_values=(('external_ids', {'iface-id': '04007ea0-4889-41fc-9716-05d8b8889b8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:96:29', 'vm-uuid': '1c1c2492-d197-4b70-a915-1c594f49f8c1'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: INFO os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:96:29,bridge_name='br-int',has_traffic_filtering=True,id=04007ea0-4889-41fc-9716-05d8b8889b8b,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04007ea0-48')
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:c4:4d,bridge_name='br-int',has_traffic_filtering=True,id=92591c00-78d2-4b18-b52d-c054eb5f2636,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92591c00-78') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c4:4d,bridge_name='br-int',has_traffic_filtering=True,id=92591c00-78d2-4b18-b52d-c054eb5f2636,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92591c00-78') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '862b8e99-1a18-50b5-bdd5-01fb6d175771', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92591c00-78, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92591c00-78, col_values=(('qos', UUID('6848dabc-7115-46f4-8bee-2b65fdc7e24d')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92591c00-78, col_values=(('external_ids', {'iface-id': '92591c00-78d2-4b18-b52d-c054eb5f2636', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:c4:4d', 'vm-uuid': '1c1c2492-d197-4b70-a915-1c594f49f8c1'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: INFO os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c4:4d,bridge_name='br-int',has_traffic_filtering=True,id=92591c00-78d2-4b18-b52d-c054eb5f2636,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92591c00-78')
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=15a53d99-f268-49f0-8ffb-14f1dbfc5a3a,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a53d99-f2') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=15a53d99-f268-49f0-8ffb-14f1dbfc5a3a,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a53d99-f2') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ce03982-4df1-5da7-af21-6ffea8151355', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15a53d99-f2, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15a53d99-f2, col_values=(('qos', UUID('360ed1ae-2315-4160-aeb4-24becf13d3d6')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15a53d99-f2, col_values=(('external_ids', {'iface-id': '15a53d99-f268-49f0-8ffb-14f1dbfc5a3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:7b:a1', 'vm-uuid': '1c1c2492-d197-4b70-a915-1c594f49f8c1'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: INFO os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=15a53d99-f268-49f0-8ffb-14f1dbfc5a3a,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a53d99-f2')
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78b07ae1-d554-41be-935f-3679ac796e28", "address": "fa:16:3e:b0:f4:b4", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07ae1-d5", "ovs_interfaceid": "78b07ae1-d554-41be-935f-3679ac796e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "78b07ae1-d554-41be-935f-3679ac796e28", "address": "fa:16:3e:b0:f4:b4", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07ae1-d5", "ovs_interfaceid": "78b07ae1-d554-41be-935f-3679ac796e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=78b07ae1-d554-41be-935f-3679ac796e28,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07ae1-d5') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=78b07ae1-d554-41be-935f-3679ac796e28,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07ae1-d5') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a007fee-cdb7-5b63-ad3c-55cada529cbf', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78b07ae1-d5, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78b07ae1-d5, col_values=(('qos', UUID('1f506f30-d98c-4266-be4e-8181d39d3703')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78b07ae1-d5, col_values=(('external_ids', {'iface-id': '78b07ae1-d554-41be-935f-3679ac796e28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:f4:b4', 'vm-uuid': '1c1c2492-d197-4b70-a915-1c594f49f8c1'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:59:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: INFO os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=78b07ae1-d554-41be-935f-3679ac796e28,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07ae1-d5')
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f4:62,bridge_name='br-int',has_traffic_filtering=True,id=cc63a63d-99d0-4fb8-9e21-182471a8b35f,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc63a63d-99') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f4:62,bridge_name='br-int',has_traffic_filtering=True,id=cc63a63d-99d0-4fb8-9e21-182471a8b35f,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc63a63d-99') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97bbfa10-c31e-50c1-862f-9719642cdd8e', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.policy [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30db3f3e090c47d4815bcdc14582ed14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600ea2b5d6174cd2a3a71944f907e59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc63a63d-99, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc63a63d-99, col_values=(('qos', UUID('8fbf0983-20a0-4bcc-ad38-d1265748e2bf')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc63a63d-99, col_values=(('external_ids', {'iface-id': 'cc63a63d-99d0-4fb8-9e21-182471a8b35f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:f4:62', 'vm-uuid': '1c1c2492-d197-4b70-a915-1c594f49f8c1'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: INFO os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f4:62,bridge_name='br-int',has_traffic_filtering=True,id=cc63a63d-99d0-4fb8-9e21-182471a8b35f,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc63a63d-99')
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f39315a-307d-4436-bdd6-fed7197dfb5e,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39315a-30') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f39315a-307d-4436-bdd6-fed7197dfb5e,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39315a-30') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96e4e41a-270c-533d-b5a0-974f3f2a1299', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:59:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Creating image(s)
Nov 14 04:59:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "/opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "/opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "/opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f39315a-30, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f39315a-30, col_values=(('qos', UUID('d88b49c4-a327-4e16-be58-3cf0d58618c8')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f39315a-30, col_values=(('external_ids', {'iface-id': '6f39315a-307d-4436-bdd6-fed7197dfb5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:45:ef', 'vm-uuid': '1c1c2492-d197-4b70-a915-1c594f49f8c1'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:37 user nova-compute[75469]: INFO os_vif [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f39315a-307d-4436-bdd6-fed7197dfb5e,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39315a-30')
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.209s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] No BDM found with device name hda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] No VIF found with MAC fa:16:3e:d3:9b:df, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] No VIF found with MAC fa:16:3e:b0:f4:b4, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:59:37 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Using config drive
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.249s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk 1073741824" returned: 0 in 0.061s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:37 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Creating config drive at /opt/stack/data/nova/instances/1c1c2492-d197-4b70-a915-1c594f49f8c1/disk.config
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1c1c2492-d197-4b70-a915-1c594f49f8c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7_yrtfo6 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1c1c2492-d197-4b70-a915-1c594f49f8c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7_yrtfo6" returned: 0 in 0.063s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Successfully created port: 2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Cannot resize image /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Ensure instance console log exists: /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Successfully updated port: 2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "refresh_cache-6048e25b-b73e-4d63-9ce3-d230dbf76876" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquired lock "refresh_cache-6048e25b-b73e-4d63-9ce3-d230dbf76876" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-d9ea5245-3329-4768-85d2-776a55c23c03 req-a9a76fab-9d12-4fd4-ad84-c3a653c3d29b service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-changed-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-d9ea5245-3329-4768-85d2-776a55c23c03 req-a9a76fab-9d12-4fd4-ad84-c3a653c3d29b service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Refreshing instance network info cache due to event network-changed-2e4570af-365a-415f-b744-e472dedcb2ee. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d9ea5245-3329-4768-85d2-776a55c23c03 req-a9a76fab-9d12-4fd4-ad84-c3a653c3d29b service nova] Acquiring lock "refresh_cache-6048e25b-b73e-4d63-9ce3-d230dbf76876" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Updating instance_info_cache with network_info: [{"id": "2e4570af-365a-415f-b744-e472dedcb2ee", "address": "fa:16:3e:09:01:b3", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4570af-36", "ovs_interfaceid": "2e4570af-365a-415f-b744-e472dedcb2ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Releasing lock "refresh_cache-6048e25b-b73e-4d63-9ce3-d230dbf76876" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Instance network_info: |[{"id": "2e4570af-365a-415f-b744-e472dedcb2ee", "address": "fa:16:3e:09:01:b3", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4570af-36", "ovs_interfaceid": "2e4570af-365a-415f-b744-e472dedcb2ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d9ea5245-3329-4768-85d2-776a55c23c03 req-a9a76fab-9d12-4fd4-ad84-c3a653c3d29b service nova] Acquired lock "refresh_cache-6048e25b-b73e-4d63-9ce3-d230dbf76876" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.network.neutron [req-d9ea5245-3329-4768-85d2-776a55c23c03 req-a9a76fab-9d12-4fd4-ad84-c3a653c3d29b service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Refreshing network info cache for port 2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Start _get_guest_xml network_info=[{"id": "2e4570af-365a-415f-b744-e472dedcb2ee", "address": "fa:16:3e:09:01:b3", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4570af-36", "ovs_interfaceid": "2e4570af-365a-415f-b744-e472dedcb2ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:59:38 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:59:38 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-170698476',display_name='tempest-VolumesSnapshotTestJSON-instance-170698476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-170698476',id=23,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtzPy+xaTtPfVMjmqnbzHUPYAAtjhCtQdOs30EiYqo8trtCUdy/obra5BdRaYxlqUg/KgE3DPCi5mPNT0sIQ9SqrI6pgLfVHID7a8hpjNFo/BsPSRjqDClDTzVnEyRXqQ==',key_name='tempest-keypair-273112233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='600ea2b5d6174cd2a3a71944f907e59a',ramdisk_id='',reservation_id='r-9icv325v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-16916651',owner_user_name='tempest-VolumesSnapshotTestJSON-16916651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30db3f3e090c47d4815bcdc14582ed14',uuid=6048e25b-b73e-4d63-9ce3-d230dbf76876,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e4570af-365a-415f-b744-e472dedcb2ee", "address": "fa:16:3e:09:01:b3", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4570af-36", "ovs_interfaceid": "2e4570af-365a-415f-b744-e472dedcb2ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converting VIF {"id": "2e4570af-365a-415f-b744-e472dedcb2ee", "address": "fa:16:3e:09:01:b3", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4570af-36", "ovs_interfaceid": "2e4570af-365a-415f-b744-e472dedcb2ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=2e4570af-365a-415f-b744-e472dedcb2ee,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4570af-36') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.objects.instance [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lazy-loading 'pci_devices' on Instance uuid 6048e25b-b73e-4d63-9ce3-d230dbf76876 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:59:38 user nova-compute[75469]:   <uuid>6048e25b-b73e-4d63-9ce3-d230dbf76876</uuid>
Nov 14 04:59:38 user nova-compute[75469]:   <name>instance-00000017</name>
Nov 14 04:59:38 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:59:38 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:59:38 user nova-compute[75469]:   <metadata>
Nov 14 04:59:38 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:59:38 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:59:38 user nova-compute[75469]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-170698476</nova:name>
Nov 14 04:59:38 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:59:38</nova:creationTime>
Nov 14 04:59:38 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:59:38 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:59:38 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:59:38 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:59:38 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:59:38 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:59:38 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:59:38 user nova-compute[75469]:       <nova:owner>
Nov 14 04:59:38 user nova-compute[75469]:         <nova:user uuid="30db3f3e090c47d4815bcdc14582ed14">tempest-VolumesSnapshotTestJSON-16916651-project-member</nova:user>
Nov 14 04:59:38 user nova-compute[75469]:         <nova:project uuid="600ea2b5d6174cd2a3a71944f907e59a">tempest-VolumesSnapshotTestJSON-16916651</nova:project>
Nov 14 04:59:38 user nova-compute[75469]:       </nova:owner>
Nov 14 04:59:38 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:59:38 user nova-compute[75469]:       <nova:ports>
Nov 14 04:59:38 user nova-compute[75469]:         <nova:port uuid="2e4570af-365a-415f-b744-e472dedcb2ee">
Nov 14 04:59:38 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 04:59:38 user nova-compute[75469]:         </nova:port>
Nov 14 04:59:38 user nova-compute[75469]:       </nova:ports>
Nov 14 04:59:38 user nova-compute[75469]:     </nova:instance>
Nov 14 04:59:38 user nova-compute[75469]:   </metadata>
Nov 14 04:59:38 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:59:38 user nova-compute[75469]:     <system>
Nov 14 04:59:38 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:59:38 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:59:38 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:59:38 user nova-compute[75469]:       <entry name="serial">6048e25b-b73e-4d63-9ce3-d230dbf76876</entry>
Nov 14 04:59:38 user nova-compute[75469]:       <entry name="uuid">6048e25b-b73e-4d63-9ce3-d230dbf76876</entry>
Nov 14 04:59:38 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:59:38 user nova-compute[75469]:     </system>
Nov 14 04:59:38 user nova-compute[75469]:   </sysinfo>
Nov 14 04:59:38 user nova-compute[75469]:   <os>
Nov 14 04:59:38 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:59:38 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:59:38 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:59:38 user nova-compute[75469]:   </os>
Nov 14 04:59:38 user nova-compute[75469]:   <features>
Nov 14 04:59:38 user nova-compute[75469]:     <acpi/>
Nov 14 04:59:38 user nova-compute[75469]:     <apic/>
Nov 14 04:59:38 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:59:38 user nova-compute[75469]:   </features>
Nov 14 04:59:38 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:59:38 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:59:38 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:59:38 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:59:38 user nova-compute[75469]:   </clock>
Nov 14 04:59:38 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:59:38 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:59:38 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:59:38 user nova-compute[75469]:   </cpu>
Nov 14 04:59:38 user nova-compute[75469]:   <devices>
Nov 14 04:59:38 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:59:38 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:59:38 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk"/>
Nov 14 04:59:38 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:59:38 user nova-compute[75469]:     </disk>
Nov 14 04:59:38 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:59:38 user nova-compute[75469]:       <mac address="fa:16:3e:09:01:b3"/>
Nov 14 04:59:38 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:38 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:59:38 user nova-compute[75469]:       <target dev="tap2e4570af-36"/>
Nov 14 04:59:38 user nova-compute[75469]:     </interface>
Nov 14 04:59:38 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:59:38 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/console.log" append="off"/>
Nov 14 04:59:38 user nova-compute[75469]:     </serial>
Nov 14 04:59:38 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:59:38 user nova-compute[75469]:     <video>
Nov 14 04:59:38 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:38 user nova-compute[75469]:     </video>
Nov 14 04:59:38 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:59:38 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:59:38 user nova-compute[75469]:     </rng>
Nov 14 04:59:38 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:59:38 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:59:38 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:59:38 user nova-compute[75469]:     </memballoon>
Nov 14 04:59:38 user nova-compute[75469]:   </devices>
Nov 14 04:59:38 user nova-compute[75469]: </domain>
Nov 14 04:59:38 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-170698476',display_name='tempest-VolumesSnapshotTestJSON-instance-170698476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-170698476',id=23,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtzPy+xaTtPfVMjmqnbzHUPYAAtjhCtQdOs30EiYqo8trtCUdy/obra5BdRaYxlqUg/KgE3DPCi5mPNT0sIQ9SqrI6pgLfVHID7a8hpjNFo/BsPSRjqDClDTzVnEyRXqQ==',key_name='tempest-keypair-273112233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='600ea2b5d6174cd2a3a71944f907e59a',ramdisk_id='',reservation_id='r-9icv325v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-16916651',owner_user_name='tempest-VolumesSnapshotTestJSON-16916651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30db3f3e090c47d4815bcdc14582ed14',uuid=6048e25b-b73e-4d63-9ce3-d230dbf76876,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e4570af-365a-415f-b744-e472dedcb2ee", "address": "fa:16:3e:09:01:b3", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4570af-36", "ovs_interfaceid": "2e4570af-365a-415f-b744-e472dedcb2ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converting VIF {"id": "2e4570af-365a-415f-b744-e472dedcb2ee", "address": "fa:16:3e:09:01:b3", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4570af-36", "ovs_interfaceid": "2e4570af-365a-415f-b744-e472dedcb2ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=2e4570af-365a-415f-b744-e472dedcb2ee,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4570af-36') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG os_vif [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=2e4570af-365a-415f-b744-e472dedcb2ee,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4570af-36') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '321786bf-3e4a-5135-a527-b05c15163a40', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e4570af-36, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e4570af-36, col_values=(('qos', UUID('02ede5cb-552e-4ac3-bb12-ca6d2235065a')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e4570af-36, col_values=(('external_ids', {'iface-id': '2e4570af-365a-415f-b744-e472dedcb2ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:01:b3', 'vm-uuid': '6048e25b-b73e-4d63-9ce3-d230dbf76876'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:38 user nova-compute[75469]: INFO os_vif [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=2e4570af-365a-415f-b744-e472dedcb2ee,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4570af-36')
Nov 14 04:59:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] No VIF found with MAC fa:16:3e:09:01:b3, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG nova.network.neutron [req-d9ea5245-3329-4768-85d2-776a55c23c03 req-a9a76fab-9d12-4fd4-ad84-c3a653c3d29b service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Updated VIF entry in instance network info cache for port 2e4570af-365a-415f-b744-e472dedcb2ee. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG nova.network.neutron [req-d9ea5245-3329-4768-85d2-776a55c23c03 req-a9a76fab-9d12-4fd4-ad84-c3a653c3d29b service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Updating instance_info_cache with network_info: [{"id": "2e4570af-365a-415f-b744-e472dedcb2ee", "address": "fa:16:3e:09:01:b3", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4570af-36", "ovs_interfaceid": "2e4570af-365a-415f-b744-e472dedcb2ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d9ea5245-3329-4768-85d2-776a55c23c03 req-a9a76fab-9d12-4fd4-ad84-c3a653c3d29b service nova] Releasing lock "refresh_cache-6048e25b-b73e-4d63-9ce3-d230dbf76876" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-4cc82482-4aa5-4ff1-a63a-6bd4ea903f6c req-8559e545-08d9-40d7-96eb-228ecb707e1b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-92591c00-78d2-4b18-b52d-c054eb5f2636 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4cc82482-4aa5-4ff1-a63a-6bd4ea903f6c req-8559e545-08d9-40d7-96eb-228ecb707e1b service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4cc82482-4aa5-4ff1-a63a-6bd4ea903f6c req-8559e545-08d9-40d7-96eb-228ecb707e1b service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4cc82482-4aa5-4ff1-a63a-6bd4ea903f6c req-8559e545-08d9-40d7-96eb-228ecb707e1b service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-4cc82482-4aa5-4ff1-a63a-6bd4ea903f6c req-8559e545-08d9-40d7-96eb-228ecb707e1b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-92591c00-78d2-4b18-b52d-c054eb5f2636 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:40 user nova-compute[75469]: WARNING nova.compute.manager [req-4cc82482-4aa5-4ff1-a63a-6bd4ea903f6c req-8559e545-08d9-40d7-96eb-228ecb707e1b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-92591c00-78d2-4b18-b52d-c054eb5f2636 for instance with vm_state building and task_state spawning.
Nov 14 04:59:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:40 user nova-compute[75469]: WARNING nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 for instance with vm_state building and task_state spawning.
Nov 14 04:59:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:40 user nova-compute[75469]: WARNING nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 for instance with vm_state building and task_state spawning.
Nov 14 04:59:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-04007ea0-4889-41fc-9716-05d8b8889b8b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-04007ea0-4889-41fc-9716-05d8b8889b8b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:40 user nova-compute[75469]: WARNING nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-04007ea0-4889-41fc-9716-05d8b8889b8b for instance with vm_state building and task_state spawning.
Nov 14 04:59:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-04007ea0-4889-41fc-9716-05d8b8889b8b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-04007ea0-4889-41fc-9716-05d8b8889b8b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:40 user nova-compute[75469]: WARNING nova.compute.manager [req-101c98a2-09a8-4c07-a127-ee6302bdd712 req-c399dc45-d8df-4ba2-8bbc-9e1cfd22f22f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-04007ea0-4889-41fc-9716-05d8b8889b8b for instance with vm_state building and task_state spawning.
Nov 14 04:59:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-92591c00-78d2-4b18-b52d-c054eb5f2636 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-92591c00-78d2-4b18-b52d-c054eb5f2636 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:42 user nova-compute[75469]: WARNING nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-92591c00-78d2-4b18-b52d-c054eb5f2636 for instance with vm_state building and task_state spawning.
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:42 user nova-compute[75469]: WARNING nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-78b07ae1-d554-41be-935f-3679ac796e28 for instance with vm_state building and task_state spawning.
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:42 user nova-compute[75469]: WARNING nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-78b07ae1-d554-41be-935f-3679ac796e28 for instance with vm_state building and task_state spawning.
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] No waiting events found dispatching network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:42 user nova-compute[75469]: WARNING nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received unexpected event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee for instance with vm_state building and task_state spawning.
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] No waiting events found dispatching network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:42 user nova-compute[75469]: WARNING nova.compute.manager [req-d25b672c-462f-4957-916e-307cc2afa0fa req-2b9fd639-0b51-4ffb-a6b0-5b75b74733c0 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received unexpected event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee for instance with vm_state building and task_state spawning.
Nov 14 04:59:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:42 user nova-compute[75469]: WARNING nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a for instance with vm_state building and task_state spawning.
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:42 user nova-compute[75469]: WARNING nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a for instance with vm_state building and task_state spawning.
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:42 user nova-compute[75469]: WARNING nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f for instance with vm_state building and task_state spawning.
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:42 user nova-compute[75469]: WARNING nova.compute.manager [req-6150aa15-c51f-4a97-9d0d-8f35a13e1cc8 req-45fbd7a2-ee78-47b7-92a7-f887b5f5f34d service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f for instance with vm_state building and task_state spawning.
Nov 14 04:59:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:44 user nova-compute[75469]: WARNING nova.compute.manager [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-6f39315a-307d-4436-bdd6-fed7197dfb5e for instance with vm_state building and task_state spawning.
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:44 user nova-compute[75469]: WARNING nova.compute.manager [req-6bf6d27a-12ba-444a-99b1-0dd938ae98f8 req-f5c55e58-79ff-4500-87ed-1e936974eacf service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-6f39315a-307d-4436-bdd6-fed7197dfb5e for instance with vm_state building and task_state spawning.
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:59:44 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Instance spawned successfully.
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:59:44 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Instance spawned successfully.
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:59:44 user nova-compute[75469]: INFO nova.compute.manager [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Took 7.94 seconds to spawn the instance on the hypervisor.
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:59:44 user nova-compute[75469]: INFO nova.compute.manager [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Took 13.11 seconds to spawn the instance on the hypervisor.
Nov 14 04:59:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:59:44 user nova-compute[75469]: INFO nova.compute.manager [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Took 8.92 seconds to build instance.
Nov 14 04:59:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bff3cb92-866d-42ed-b2e4-39617b8e1f2b tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.043s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:45 user nova-compute[75469]: INFO nova.compute.manager [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Took 28.95 seconds to build instance.
Nov 14 04:59:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6df2f359-a8f8-41cf-8a7d-06de024c7e15 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.042s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:48 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:59:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:59:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:59:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:48 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:59:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 80741f98-11b9-4a80-a51b-39d5ce4e44f5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:48 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updating instance_info_cache with network_info: [{"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:59:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:59:49 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:59:49 user nova-compute[75469]: DEBUG nova.objects.instance [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquired lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:49 user nova-compute[75469]: DEBUG nova.network.neutron [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:59:49 user nova-compute[75469]: DEBUG nova.objects.instance [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'info_cache' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:49 user nova-compute[75469]: DEBUG nova.objects.base [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updating instance_info_cache with network_info: [{"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Releasing lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:50 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance destroyed successfully.
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.objects.instance [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'resources' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.objects.base [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1216043162',display_name='tempest-AttachVolumeTestJSON-server-1216043162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1216043162',id=3,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmvdCBIfh48Eeknk9EcyhY/EUByia8dNJsdA49UBgYl79YeoAE1ZBCnXslVyMxP+0apbX7EEDT0C15puJDnVXndeeRGIR/eT6s8JeH6vqhOdqMbAiRlzvoMhvGWyeiHSA==',key_name='tempest-keypair-539876909',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-s5b510vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=68c68428-4d79-4dd7-94a1-9c05e5230a8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG os_vif [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d0308df-4e, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f040c914-d94d-4d22-b788-288442741ea9) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:50 user nova-compute[75469]: INFO os_vif [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e')
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Start _get_guest_xml network_info=[{"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.objects.instance [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'numa_topology' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.objects.base [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:59:50 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:59:50 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.objects.instance [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.objects.base [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1216043162',display_name='tempest-AttachVolumeTestJSON-server-1216043162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1216043162',id=3,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmvdCBIfh48Eeknk9EcyhY/EUByia8dNJsdA49UBgYl79YeoAE1ZBCnXslVyMxP+0apbX7EEDT0C15puJDnVXndeeRGIR/eT6s8JeH6vqhOdqMbAiRlzvoMhvGWyeiHSA==',key_name='tempest-keypair-539876909',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-s5b510vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=68c68428-4d79-4dd7-94a1-9c05e5230a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.objects.instance [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'pci_devices' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.objects.base [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:59:50 user nova-compute[75469]:   <uuid>68c68428-4d79-4dd7-94a1-9c05e5230a8a</uuid>
Nov 14 04:59:50 user nova-compute[75469]:   <name>instance-00000003</name>
Nov 14 04:59:50 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 04:59:50 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 04:59:50 user nova-compute[75469]:   <metadata>
Nov 14 04:59:50 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:59:50 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 04:59:50 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeTestJSON-server-1216043162</nova:name>
Nov 14 04:59:50 user nova-compute[75469]:       <nova:creationTime>2023-11-14 04:59:50</nova:creationTime>
Nov 14 04:59:50 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 04:59:50 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 04:59:50 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 04:59:50 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 04:59:50 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:59:50 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:59:50 user nova-compute[75469]:       </nova:flavor>
Nov 14 04:59:50 user nova-compute[75469]:       <nova:owner>
Nov 14 04:59:50 user nova-compute[75469]:         <nova:user uuid="3142f0a24ee841878d06e14817fa1f86">tempest-AttachVolumeTestJSON-2079958443-project-member</nova:user>
Nov 14 04:59:50 user nova-compute[75469]:         <nova:project uuid="f7e85721ebed4cccaecde59d1944cd64">tempest-AttachVolumeTestJSON-2079958443</nova:project>
Nov 14 04:59:50 user nova-compute[75469]:       </nova:owner>
Nov 14 04:59:50 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 04:59:50 user nova-compute[75469]:       <nova:ports>
Nov 14 04:59:50 user nova-compute[75469]:         <nova:port uuid="5d0308df-4ec4-495c-b85e-73900b018564">
Nov 14 04:59:50 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 04:59:50 user nova-compute[75469]:         </nova:port>
Nov 14 04:59:50 user nova-compute[75469]:       </nova:ports>
Nov 14 04:59:50 user nova-compute[75469]:     </nova:instance>
Nov 14 04:59:50 user nova-compute[75469]:   </metadata>
Nov 14 04:59:50 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 04:59:50 user nova-compute[75469]:     <system>
Nov 14 04:59:50 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:59:50 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:59:50 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 04:59:50 user nova-compute[75469]:       <entry name="serial">68c68428-4d79-4dd7-94a1-9c05e5230a8a</entry>
Nov 14 04:59:50 user nova-compute[75469]:       <entry name="uuid">68c68428-4d79-4dd7-94a1-9c05e5230a8a</entry>
Nov 14 04:59:50 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:59:50 user nova-compute[75469]:     </system>
Nov 14 04:59:50 user nova-compute[75469]:   </sysinfo>
Nov 14 04:59:50 user nova-compute[75469]:   <os>
Nov 14 04:59:50 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:59:50 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 04:59:50 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 04:59:50 user nova-compute[75469]:   </os>
Nov 14 04:59:50 user nova-compute[75469]:   <features>
Nov 14 04:59:50 user nova-compute[75469]:     <acpi/>
Nov 14 04:59:50 user nova-compute[75469]:     <apic/>
Nov 14 04:59:50 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 04:59:50 user nova-compute[75469]:   </features>
Nov 14 04:59:50 user nova-compute[75469]:   <clock offset="utc">
Nov 14 04:59:50 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:59:50 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:59:50 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 04:59:50 user nova-compute[75469]:   </clock>
Nov 14 04:59:50 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 04:59:50 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 04:59:50 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:59:50 user nova-compute[75469]:   </cpu>
Nov 14 04:59:50 user nova-compute[75469]:   <devices>
Nov 14 04:59:50 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 04:59:50 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:59:50 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk"/>
Nov 14 04:59:50 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 04:59:50 user nova-compute[75469]:     </disk>
Nov 14 04:59:50 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 04:59:50 user nova-compute[75469]:       <mac address="fa:16:3e:de:a7:a6"/>
Nov 14 04:59:50 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:50 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 04:59:50 user nova-compute[75469]:       <target dev="tap5d0308df-4e"/>
Nov 14 04:59:50 user nova-compute[75469]:     </interface>
Nov 14 04:59:50 user nova-compute[75469]:     <serial type="pty">
Nov 14 04:59:50 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/console.log" append="off"/>
Nov 14 04:59:50 user nova-compute[75469]:     </serial>
Nov 14 04:59:50 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:59:50 user nova-compute[75469]:     <video>
Nov 14 04:59:50 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 04:59:50 user nova-compute[75469]:     </video>
Nov 14 04:59:50 user nova-compute[75469]:     <rng model="virtio">
Nov 14 04:59:50 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:59:50 user nova-compute[75469]:     </rng>
Nov 14 04:59:50 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:59:50 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 04:59:50 user nova-compute[75469]:       <stats period="10"/>
Nov 14 04:59:50 user nova-compute[75469]:     </memballoon>
Nov 14 04:59:50 user nova-compute[75469]:   </devices>
Nov 14 04:59:50 user nova-compute[75469]: </domain>
Nov 14 04:59:50 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.objects.instance [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG nova.objects.base [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:59:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Cannot resize image /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG nova.objects.instance [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'migration_context' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG nova.objects.base [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Object Instance<68c68428-4d79-4dd7-94a1-9c05e5230a8a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1216043162',display_name='tempest-AttachVolumeTestJSON-server-1216043162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1216043162',id=3,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmvdCBIfh48Eeknk9EcyhY/EUByia8dNJsdA49UBgYl79YeoAE1ZBCnXslVyMxP+0apbX7EEDT0C15puJDnVXndeeRGIR/eT6s8JeH6vqhOdqMbAiRlzvoMhvGWyeiHSA==',key_name='tempest-keypair-539876909',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-s5b510vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=68c68428-4d79-4dd7-94a1-9c05e5230a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG os_vif [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1e8656f-16a2-578d-bfd2-34de9ddc4abe', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d0308df-4e, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d0308df-4e, col_values=(('qos', UUID('60b61529-3cdb-4d58-b1ff-dabb10590a79')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d0308df-4e, col_values=(('external_ids', {'iface-id': '5d0308df-4ec4-495c-b85e-73900b018564', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:a7:a6', 'vm-uuid': '68c68428-4d79-4dd7-94a1-9c05e5230a8a'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:51 user nova-compute[75469]: INFO os_vif [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e')
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-34c23cbd-3ee3-4aea-878e-5a8b9a580656 req-74902bbd-e8c5-4659-99e4-ba185b51a396 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-34c23cbd-3ee3-4aea-878e-5a8b9a580656 req-74902bbd-e8c5-4659-99e4-ba185b51a396 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-34c23cbd-3ee3-4aea-878e-5a8b9a580656 req-74902bbd-e8c5-4659-99e4-ba185b51a396 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-34c23cbd-3ee3-4aea-878e-5a8b9a580656 req-74902bbd-e8c5-4659-99e4-ba185b51a396 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-34c23cbd-3ee3-4aea-878e-5a8b9a580656 req-74902bbd-e8c5-4659-99e4-ba185b51a396 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:53 user nova-compute[75469]: WARNING nova.compute.manager [req-34c23cbd-3ee3-4aea-878e-5a8b9a580656 req-74902bbd-e8c5-4659-99e4-ba185b51a396 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state stopped and task_state powering-on.
Nov 14 04:59:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:59:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.manager [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-051bc5cb-9a42-4e3a-a444-34aa989ef6dd req-e0b2ee2d-eece-43cc-bee2-2a8eef557219 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-051bc5cb-9a42-4e3a-a444-34aa989ef6dd req-e0b2ee2d-eece-43cc-bee2-2a8eef557219 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-051bc5cb-9a42-4e3a-a444-34aa989ef6dd req-e0b2ee2d-eece-43cc-bee2-2a8eef557219 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-051bc5cb-9a42-4e3a-a444-34aa989ef6dd req-e0b2ee2d-eece-43cc-bee2-2a8eef557219 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-051bc5cb-9a42-4e3a-a444-34aa989ef6dd req-e0b2ee2d-eece-43cc-bee2-2a8eef557219 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:55 user nova-compute[75469]: WARNING nova.compute.manager [req-051bc5cb-9a42-4e3a-a444-34aa989ef6dd req-e0b2ee2d-eece-43cc-bee2-2a8eef557219 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state stopped and task_state powering-on.
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-27020708-c6f4-4dc5-9118-4f73bc47fc9d req-f92c0a8b-c98d-4610-9f11-411dd4cf83ff service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Received event network-changed-c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-27020708-c6f4-4dc5-9118-4f73bc47fc9d req-f92c0a8b-c98d-4610-9f11-411dd4cf83ff service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Refreshing instance network info cache due to event network-changed-c9835e10-aae6-469f-b1dc-7a6216a58e07. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-27020708-c6f4-4dc5-9118-4f73bc47fc9d req-f92c0a8b-c98d-4610-9f11-411dd4cf83ff service nova] Acquiring lock "refresh_cache-708da3a8-c9ce-4d36-87f4-658756b11481" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-27020708-c6f4-4dc5-9118-4f73bc47fc9d req-f92c0a8b-c98d-4610-9f11-411dd4cf83ff service nova] Acquired lock "refresh_cache-708da3a8-c9ce-4d36-87f4-658756b11481" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.network.neutron [req-27020708-c6f4-4dc5-9118-4f73bc47fc9d req-f92c0a8b-c98d-4610-9f11-411dd4cf83ff service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Refreshing network info cache for port c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:59:55 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:59:55 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7635MB free_disk=25.055583953857422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance rebooted successfully.
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.manager [None req-df2d3f82-f5b6-4ded-a6be-33e830bbce0e tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance fb551839-7b5a-4ecd-b9c0-ab53addeaa45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c0ca77d2-8353-4dfc-beed-ac479535b5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 708da3a8-c9ce-4d36-87f4-658756b11481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 00eaa54c-e711-4c19-adbe-ed90dcc46293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 1c1c2492-d197-4b70-a915-1c594f49f8c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance ff1ee641-8abc-4e0e-acfe-b48859a428da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6048e25b-b73e-4d63-9ce3-d230dbf76876 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:59:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:59:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:56 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:59:56 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:59:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:59:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.752s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:56 user nova-compute[75469]: DEBUG nova.network.neutron [req-27020708-c6f4-4dc5-9118-4f73bc47fc9d req-f92c0a8b-c98d-4610-9f11-411dd4cf83ff service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Updated VIF entry in instance network info cache for port c9835e10-aae6-469f-b1dc-7a6216a58e07. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:59:56 user nova-compute[75469]: DEBUG nova.network.neutron [req-27020708-c6f4-4dc5-9118-4f73bc47fc9d req-f92c0a8b-c98d-4610-9f11-411dd4cf83ff service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Updating instance_info_cache with network_info: [{"id": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "address": "fa:16:3e:dc:92:d0", "network": {"id": "a0ea6d0c-3672-45ef-8b6d-252e834a4c8a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-207125075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db1ce6a2889c4e7892cedf0074e02a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9835e10-aa", "ovs_interfaceid": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-27020708-c6f4-4dc5-9118-4f73bc47fc9d req-f92c0a8b-c98d-4610-9f11-411dd4cf83ff service nova] Releasing lock "refresh_cache-708da3a8-c9ce-4d36-87f4-658756b11481" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "00eaa54c-e711-4c19-adbe-ed90dcc46293" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.007s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:57 user nova-compute[75469]: INFO nova.compute.manager [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Terminating instance
Nov 14 04:59:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Received event network-changed-3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Refreshing instance network info cache due to event network-changed-3b440674-f174-4469-9053-32e9b4b6a193. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] Acquiring lock "refresh_cache-00eaa54c-e711-4c19-adbe-ed90dcc46293" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] Acquired lock "refresh_cache-00eaa54c-e711-4c19-adbe-ed90dcc46293" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG nova.network.neutron [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Refreshing network info cache for port 3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:57 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Instance destroyed successfully.
Nov 14 04:59:57 user nova-compute[75469]: DEBUG nova.objects.instance [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'resources' on Instance uuid 00eaa54c-e711-4c19-adbe-ed90dcc46293 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1908253860',display_name='tempest-AttachVolumeNegativeTest-server-1908253860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1908253860',id=20,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeZiMeIlmtDa0CSAzZGcAeyZ/+edk3NnuPPx3tPNIoaWTZ9r+Mb7b3HsHj92XWClP3U9/8deSsX5o1yBJNd264M0MI0S/WTBqglVYebjcPmmZJ3vhG30IZvak23Ffulqg==',key_name='tempest-keypair-1258865171',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-mm0w092z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=00eaa54c-e711-4c19-adbe-ed90dcc46293,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b440674-f174-4469-9053-32e9b4b6a193", "address": "fa:16:3e:6c:25:8b", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b440674-f1", "ovs_interfaceid": "3b440674-f174-4469-9053-32e9b4b6a193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "3b440674-f174-4469-9053-32e9b4b6a193", "address": "fa:16:3e:6c:25:8b", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b440674-f1", "ovs_interfaceid": "3b440674-f174-4469-9053-32e9b4b6a193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:25:8b,bridge_name='br-int',has_traffic_filtering=True,id=3b440674-f174-4469-9053-32e9b4b6a193,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b440674-f1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG os_vif [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:25:8b,bridge_name='br-int',has_traffic_filtering=True,id=3b440674-f174-4469-9053-32e9b4b6a193,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b440674-f1') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b440674-f1, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1b96114-08d5-49b0-8fee-19674525aa5c) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "708da3a8-c9ce-4d36-87f4-658756b11481" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:58 user nova-compute[75469]: INFO os_vif [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:25:8b,bridge_name='br-int',has_traffic_filtering=True,id=3b440674-f174-4469-9053-32e9b4b6a193,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b440674-f1')
Nov 14 04:59:58 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Deleting instance files /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293_del
Nov 14 04:59:58 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Deletion of /opt/stack/data/nova/instances/00eaa54c-e711-4c19-adbe-ed90dcc46293_del complete
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.objects.instance [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lazy-loading 'flavor' on Instance uuid 708da3a8-c9ce-4d36-87f4-658756b11481 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:58 user nova-compute[75469]: INFO nova.compute.manager [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "708da3a8-c9ce-4d36-87f4-658756b11481" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:58 user nova-compute[75469]: INFO nova.compute.manager [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Attaching volume 216395d2-05c6-426a-9342-57438ecbf730 to /dev/vdb
Nov 14 04:59:58 user nova-compute[75469]: DEBUG os_brick.utils [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c75a57-1160-406b-b25f-4ba9f7676d49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf10cde-2777-4660-bca6-f931a25e1475]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e5bdb5-0130-4ce1-bfc0-cc2982b0d31b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[80330214-e16b-42b6-9098-06bc4a4fd8a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:59:58 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e61fc7-0cae-4ded-8c37-39fb05c0858c]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG os_brick.utils [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Updating existing volume attachment record: 2356c604-d405-4029-a5f9-ff1841912cf4 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.network.neutron [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Updated VIF entry in instance network info cache for port 3b440674-f174-4469-9053-32e9b4b6a193. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.network.neutron [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Updating instance_info_cache with network_info: [{"id": "3b440674-f174-4469-9053-32e9b4b6a193", "address": "fa:16:3e:6c:25:8b", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b440674-f1", "ovs_interfaceid": "3b440674-f174-4469-9053-32e9b4b6a193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] Releasing lock "refresh_cache-00eaa54c-e711-4c19-adbe-ed90dcc46293" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Received event network-vif-unplugged-3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] Acquiring lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] No waiting events found dispatching network-vif-unplugged-3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-b21e328c-fbee-49d9-b7de-251bf70debba req-9d26da4f-7da5-4157-9845-5778653e92c1 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Received event network-vif-unplugged-3b440674-f174-4469-9053-32e9b4b6a193 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:59:59 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:59:59 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Took 1.08 seconds to deallocate network for instance.
Nov 14 04:59:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:59 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:59:59 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:59:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:59 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Deleted allocations for instance 00eaa54c-e711-4c19-adbe-ed90dcc46293
Nov 14 04:59:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-5ab05d29-a402-4ffd-a6cd-cf7e51f190ca req-54e3aa3e-0eb5-4bb6-b8c6-3d10b40db743 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Received event network-vif-plugged-3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5ab05d29-a402-4ffd-a6cd-cf7e51f190ca req-54e3aa3e-0eb5-4bb6-b8c6-3d10b40db743 service nova] Acquiring lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:59:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5ab05d29-a402-4ffd-a6cd-cf7e51f190ca req-54e3aa3e-0eb5-4bb6-b8c6-3d10b40db743 service nova] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:59:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5ab05d29-a402-4ffd-a6cd-cf7e51f190ca req-54e3aa3e-0eb5-4bb6-b8c6-3d10b40db743 service nova] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:59:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-5ab05d29-a402-4ffd-a6cd-cf7e51f190ca req-54e3aa3e-0eb5-4bb6-b8c6-3d10b40db743 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] No waiting events found dispatching network-vif-plugged-3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:59:59 user nova-compute[75469]: WARNING nova.compute.manager [req-5ab05d29-a402-4ffd-a6cd-cf7e51f190ca req-54e3aa3e-0eb5-4bb6-b8c6-3d10b40db743 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Received unexpected event network-vif-plugged-3b440674-f174-4469-9053-32e9b4b6a193 for instance with vm_state deleted and task_state None.
Nov 14 04:59:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-5ab05d29-a402-4ffd-a6cd-cf7e51f190ca req-54e3aa3e-0eb5-4bb6-b8c6-3d10b40db743 service nova] [instance: 00eaa54c-e711-4c19-adbe-ed90dcc46293] Received event network-vif-deleted-3b440674-f174-4469-9053-32e9b4b6a193 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:59:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0bb6df68-ebda-4c09-9bc3-a66b0632d388 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "00eaa54c-e711-4c19-adbe-ed90dcc46293" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.486s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyAXSIqa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:00:03 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:00:03 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:00:03 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4794c60e-4c2f-4b4c-a807-8e5cd8907eb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:00:03 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c191ec9-a4bc-43bd-9a01-bc87c35bb164]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730] added
Nov 14 05:00:03 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c686786e-fa1d-485b-a3df-e8b698f10e8c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[72279f1d-ad3e-4914-86c2-a2ae18ed8908]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyAXSIqa {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyAXSIqa" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c354b2-bf77-475a-afe5-e7211a25c5c1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YyAXSIqa'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66fdffe-dcd9-4a68-b3c3-6d0751e64dbf]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6039327-f4eb-4790-8b75-d4490a487aad]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:03 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 05:00:03 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:03 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:03 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:03 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:03 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:03 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 05:00:03 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:03 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:03 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:03 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:03 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:00:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7067e2-6e11-4484-b3ea-66e572cc76a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730, portal: 172.16.0.220,3260]
Nov 14 05:00:04 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730, portal: 172.16.0.220,3260] successful.
Nov 14 05:00:04 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01d8a42-13dd-45b0-8cdc-d6589c6721f2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[032fc928-0cc0-474c-a8c5-07352f528a4c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 (non-flash)
Nov 14 05:00:04 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] HCTL ('39', '-', '-', 0) found on session 28 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[264ea01c-9265-4eee-854a-d8d2f9b553fa]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:04 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Searching for a device in session 28 and hctl ['39', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Searching for a device in session 28 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyAXSIqa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23262666535656238', 'path': '/dev/sdh'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262666535656238', 'path': '/dev/sdh'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG nova.objects.instance [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lazy-loading 'flavor' on Instance uuid 708da3a8-c9ce-4d36-87f4-658756b11481 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:00:05 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:00:05 user nova-compute[75469]:   <source dev="/dev/sdh"/>
Nov 14 05:00:05 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:00:05 user nova-compute[75469]:   <serial>216395d2-05c6-426a-9342-57438ecbf730</serial>
Nov 14 05:00:05 user nova-compute[75469]: </disk>
Nov 14 05:00:05 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:00:05 user nova-compute[75469]: INFO nova.compute.claims [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Claim successful on node user
Nov 14 05:00:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] No VIF found with MAC fa:16:3e:dc:92:d0, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:00:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5345c96a-0fe4-492b-8a65-e4401d149da6 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.525s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG nova.network.neutron [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:00:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:00:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG nova.policy [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e4d3841e8f442b481b37158345b70fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad90788eab8447f81cc0d61de06bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:00:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Creating image(s)
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "/opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "/opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "/opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.197s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk 1073741824" returned: 0 in 0.054s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:06 user nova-compute[75469]: DEBUG nova.network.neutron [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Successfully created port: 8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.196s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Cannot resize image /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Ensure instance console log exists: /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Successfully updated port: 8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "refresh_cache-33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquired lock "refresh_cache-33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-8282fa6a-8c5a-4375-ae35-0b22f0786114 req-2b9e7618-2512-46d2-86e5-4d0fb793a4d4 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Received event network-changed-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-8282fa6a-8c5a-4375-ae35-0b22f0786114 req-2b9e7618-2512-46d2-86e5-4d0fb793a4d4 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Refreshing instance network info cache due to event network-changed-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8282fa6a-8c5a-4375-ae35-0b22f0786114 req-2b9e7618-2512-46d2-86e5-4d0fb793a4d4 service nova] Acquiring lock "refresh_cache-33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:00:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Updating instance_info_cache with network_info: [{"id": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "address": "fa:16:3e:35:aa:fe", "network": {"id": "7d797163-143e-46be-a28c-b80b41197936", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2041146029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad90788eab8447f81cc0d61de06bf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae34f9c-ed", "ovs_interfaceid": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Releasing lock "refresh_cache-33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.compute.manager [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Instance network_info: |[{"id": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "address": "fa:16:3e:35:aa:fe", "network": {"id": "7d797163-143e-46be-a28c-b80b41197936", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2041146029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad90788eab8447f81cc0d61de06bf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae34f9c-ed", "ovs_interfaceid": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8282fa6a-8c5a-4375-ae35-0b22f0786114 req-2b9e7618-2512-46d2-86e5-4d0fb793a4d4 service nova] Acquired lock "refresh_cache-33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.network.neutron [req-8282fa6a-8c5a-4375-ae35-0b22f0786114 req-2b9e7618-2512-46d2-86e5-4d0fb793a4d4 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Refreshing network info cache for port 8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Start _get_guest_xml network_info=[{"id": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "address": "fa:16:3e:35:aa:fe", "network": {"id": "7d797163-143e-46be-a28c-b80b41197936", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2041146029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad90788eab8447f81cc0d61de06bf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae34f9c-ed", "ovs_interfaceid": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:08 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:00:08 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-317306228',display_name='tempest-TestServerVolumeAttachmentScenario-server-317306228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-317306228',id=24,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhUljgWB+VdbetBo1PVwMWeK9zZRUd4aDHcBeaFxt0V63YccOwb9AnUNU8ffW0wHyV+MowIvsjiRKp6sBvucsOYS2EPzMkHU8/p/yDLxLIpIttfK/9KzTi83elX1ZOjzQ==',key_name='tempest-keypair-828966378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad90788eab8447f81cc0d61de06bf1c',ramdisk_id='',reservation_id='r-ywu9q0cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2145462310',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2145462310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:00:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e4d3841e8f442b481b37158345b70fd',uuid=33c70f0a-fac9-4eda-96a4-c3bf693a9f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "address": "fa:16:3e:35:aa:fe", "network": {"id": "7d797163-143e-46be-a28c-b80b41197936", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2041146029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad90788eab8447f81cc0d61de06bf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae34f9c-ed", "ovs_interfaceid": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Converting VIF {"id": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "address": "fa:16:3e:35:aa:fe", "network": {"id": "7d797163-143e-46be-a28c-b80b41197936", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2041146029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad90788eab8447f81cc0d61de06bf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae34f9c-ed", "ovs_interfaceid": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:aa:fe,bridge_name='br-int',has_traffic_filtering=True,id=8ae34f9c-edaa-41e5-a2f8-2da19cd476fc,network=Network(7d797163-143e-46be-a28c-b80b41197936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae34f9c-ed') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.objects.instance [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lazy-loading 'pci_devices' on Instance uuid 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:00:08 user nova-compute[75469]:   <uuid>33c70f0a-fac9-4eda-96a4-c3bf693a9f7f</uuid>
Nov 14 05:00:08 user nova-compute[75469]:   <name>instance-00000018</name>
Nov 14 05:00:08 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:00:08 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:00:08 user nova-compute[75469]:   <metadata>
Nov 14 05:00:08 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:00:08 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:00:08 user nova-compute[75469]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-317306228</nova:name>
Nov 14 05:00:08 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:00:08</nova:creationTime>
Nov 14 05:00:08 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:00:08 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:00:08 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:00:08 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:00:08 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:00:08 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:00:08 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:00:08 user nova-compute[75469]:       <nova:owner>
Nov 14 05:00:08 user nova-compute[75469]:         <nova:user uuid="8e4d3841e8f442b481b37158345b70fd">tempest-TestServerVolumeAttachmentScenario-2145462310-project-member</nova:user>
Nov 14 05:00:08 user nova-compute[75469]:         <nova:project uuid="bad90788eab8447f81cc0d61de06bf1c">tempest-TestServerVolumeAttachmentScenario-2145462310</nova:project>
Nov 14 05:00:08 user nova-compute[75469]:       </nova:owner>
Nov 14 05:00:08 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:00:08 user nova-compute[75469]:       <nova:ports>
Nov 14 05:00:08 user nova-compute[75469]:         <nova:port uuid="8ae34f9c-edaa-41e5-a2f8-2da19cd476fc">
Nov 14 05:00:08 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 05:00:08 user nova-compute[75469]:         </nova:port>
Nov 14 05:00:08 user nova-compute[75469]:       </nova:ports>
Nov 14 05:00:08 user nova-compute[75469]:     </nova:instance>
Nov 14 05:00:08 user nova-compute[75469]:   </metadata>
Nov 14 05:00:08 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:00:08 user nova-compute[75469]:     <system>
Nov 14 05:00:08 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:00:08 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:00:08 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:00:08 user nova-compute[75469]:       <entry name="serial">33c70f0a-fac9-4eda-96a4-c3bf693a9f7f</entry>
Nov 14 05:00:08 user nova-compute[75469]:       <entry name="uuid">33c70f0a-fac9-4eda-96a4-c3bf693a9f7f</entry>
Nov 14 05:00:08 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:00:08 user nova-compute[75469]:     </system>
Nov 14 05:00:08 user nova-compute[75469]:   </sysinfo>
Nov 14 05:00:08 user nova-compute[75469]:   <os>
Nov 14 05:00:08 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:00:08 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:00:08 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:00:08 user nova-compute[75469]:   </os>
Nov 14 05:00:08 user nova-compute[75469]:   <features>
Nov 14 05:00:08 user nova-compute[75469]:     <acpi/>
Nov 14 05:00:08 user nova-compute[75469]:     <apic/>
Nov 14 05:00:08 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:00:08 user nova-compute[75469]:   </features>
Nov 14 05:00:08 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:00:08 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:00:08 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:00:08 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:00:08 user nova-compute[75469]:   </clock>
Nov 14 05:00:08 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:00:08 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:00:08 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:00:08 user nova-compute[75469]:   </cpu>
Nov 14 05:00:08 user nova-compute[75469]:   <devices>
Nov 14 05:00:08 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:00:08 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:00:08 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk"/>
Nov 14 05:00:08 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:00:08 user nova-compute[75469]:     </disk>
Nov 14 05:00:08 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:00:08 user nova-compute[75469]:       <mac address="fa:16:3e:35:aa:fe"/>
Nov 14 05:00:08 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:00:08 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:00:08 user nova-compute[75469]:       <target dev="tap8ae34f9c-ed"/>
Nov 14 05:00:08 user nova-compute[75469]:     </interface>
Nov 14 05:00:08 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:00:08 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/console.log" append="off"/>
Nov 14 05:00:08 user nova-compute[75469]:     </serial>
Nov 14 05:00:08 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:00:08 user nova-compute[75469]:     <video>
Nov 14 05:00:08 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:00:08 user nova-compute[75469]:     </video>
Nov 14 05:00:08 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:00:08 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:00:08 user nova-compute[75469]:     </rng>
Nov 14 05:00:08 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:00:08 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:00:08 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:00:08 user nova-compute[75469]:     </memballoon>
Nov 14 05:00:08 user nova-compute[75469]:   </devices>
Nov 14 05:00:08 user nova-compute[75469]: </domain>
Nov 14 05:00:08 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-317306228',display_name='tempest-TestServerVolumeAttachmentScenario-server-317306228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-317306228',id=24,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhUljgWB+VdbetBo1PVwMWeK9zZRUd4aDHcBeaFxt0V63YccOwb9AnUNU8ffW0wHyV+MowIvsjiRKp6sBvucsOYS2EPzMkHU8/p/yDLxLIpIttfK/9KzTi83elX1ZOjzQ==',key_name='tempest-keypair-828966378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad90788eab8447f81cc0d61de06bf1c',ramdisk_id='',reservation_id='r-ywu9q0cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2145462310',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2145462310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:00:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e4d3841e8f442b481b37158345b70fd',uuid=33c70f0a-fac9-4eda-96a4-c3bf693a9f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "address": "fa:16:3e:35:aa:fe", "network": {"id": "7d797163-143e-46be-a28c-b80b41197936", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2041146029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad90788eab8447f81cc0d61de06bf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae34f9c-ed", "ovs_interfaceid": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Converting VIF {"id": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "address": "fa:16:3e:35:aa:fe", "network": {"id": "7d797163-143e-46be-a28c-b80b41197936", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2041146029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad90788eab8447f81cc0d61de06bf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae34f9c-ed", "ovs_interfaceid": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:aa:fe,bridge_name='br-int',has_traffic_filtering=True,id=8ae34f9c-edaa-41e5-a2f8-2da19cd476fc,network=Network(7d797163-143e-46be-a28c-b80b41197936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae34f9c-ed') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG os_vif [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:aa:fe,bridge_name='br-int',has_traffic_filtering=True,id=8ae34f9c-edaa-41e5-a2f8-2da19cd476fc,network=Network(7d797163-143e-46be-a28c-b80b41197936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae34f9c-ed') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5a817e3-aaec-5ab9-b905-c14387614f57', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ae34f9c-ed, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ae34f9c-ed, col_values=(('qos', UUID('943c418b-65a0-4589-ac81-1fc1aeaa714c')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ae34f9c-ed, col_values=(('external_ids', {'iface-id': '8ae34f9c-edaa-41e5-a2f8-2da19cd476fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:aa:fe', 'vm-uuid': '33c70f0a-fac9-4eda-96a4-c3bf693a9f7f'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:08 user nova-compute[75469]: INFO os_vif [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:aa:fe,bridge_name='br-int',has_traffic_filtering=True,id=8ae34f9c-edaa-41e5-a2f8-2da19cd476fc,network=Network(7d797163-143e-46be-a28c-b80b41197936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae34f9c-ed')
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] No VIF found with MAC fa:16:3e:35:aa:fe, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.network.neutron [req-8282fa6a-8c5a-4375-ae35-0b22f0786114 req-2b9e7618-2512-46d2-86e5-4d0fb793a4d4 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Updated VIF entry in instance network info cache for port 8ae34f9c-edaa-41e5-a2f8-2da19cd476fc. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.network.neutron [req-8282fa6a-8c5a-4375-ae35-0b22f0786114 req-2b9e7618-2512-46d2-86e5-4d0fb793a4d4 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Updating instance_info_cache with network_info: [{"id": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "address": "fa:16:3e:35:aa:fe", "network": {"id": "7d797163-143e-46be-a28c-b80b41197936", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2041146029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad90788eab8447f81cc0d61de06bf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae34f9c-ed", "ovs_interfaceid": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8282fa6a-8c5a-4375-ae35-0b22f0786114 req-2b9e7618-2512-46d2-86e5-4d0fb793a4d4 service nova] Releasing lock "refresh_cache-33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "708da3a8-c9ce-4d36-87f4-658756b11481" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:08 user nova-compute[75469]: INFO nova.compute.manager [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Detaching volume 216395d2-05c6-426a-9342-57438ecbf730
Nov 14 05:00:08 user nova-compute[75469]: INFO nova.virt.block_device [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Attempting to driver detach volume 216395d2-05c6-426a-9342-57438ecbf730 from mountpoint /dev/vdb
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Attempting to detach device vdb from instance 708da3a8-c9ce-4d36-87f4-658756b11481 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:00:08 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:00:08 user nova-compute[75469]:   <source dev="/dev/sdh"/>
Nov 14 05:00:08 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:00:08 user nova-compute[75469]:   <serial>216395d2-05c6-426a-9342-57438ecbf730</serial>
Nov 14 05:00:08 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:00:08 user nova-compute[75469]: </disk>
Nov 14 05:00:08 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:00:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Successfully detached device vdb from instance 708da3a8-c9ce-4d36-87f4-658756b11481 from the persistent domain config.
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 708da3a8-c9ce-4d36-87f4-658756b11481 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:00:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:00:08 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:00:08 user nova-compute[75469]:   <source dev="/dev/sdh"/>
Nov 14 05:00:08 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:00:08 user nova-compute[75469]:   <serial>216395d2-05c6-426a-9342-57438ecbf730</serial>
Nov 14 05:00:08 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:00:08 user nova-compute[75469]: </disk>
Nov 14 05:00:08 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:00:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 708da3a8-c9ce-4d36-87f4-658756b11481 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:00:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-c1299554-7557-4166-9c74-56b1df649406 req-71de82ce-f400-4ada-8495-60f0a93a6efb service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Received event network-vif-plugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c1299554-7557-4166-9c74-56b1df649406 req-71de82ce-f400-4ada-8495-60f0a93a6efb service nova] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c1299554-7557-4166-9c74-56b1df649406 req-71de82ce-f400-4ada-8495-60f0a93a6efb service nova] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c1299554-7557-4166-9c74-56b1df649406 req-71de82ce-f400-4ada-8495-60f0a93a6efb service nova] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-c1299554-7557-4166-9c74-56b1df649406 req-71de82ce-f400-4ada-8495-60f0a93a6efb service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] No waiting events found dispatching network-vif-plugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:00:09 user nova-compute[75469]: WARNING nova.compute.manager [req-c1299554-7557-4166-9c74-56b1df649406 req-71de82ce-f400-4ada-8495-60f0a93a6efb service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Received unexpected event network-vif-plugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc for instance with vm_state building and task_state spawning.
Nov 14 05:00:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:11 user nova-compute[75469]: DEBUG nova.compute.manager [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:00:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:00:11 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Instance spawned successfully.
Nov 14 05:00:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:00:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-1717b801-f282-47b6-ad0f-d3355e7b02be req-8185d092-5399-41f9-919d-ca9b027e82a4 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Received event network-vif-plugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1717b801-f282-47b6-ad0f-d3355e7b02be req-8185d092-5399-41f9-919d-ca9b027e82a4 service nova] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1717b801-f282-47b6-ad0f-d3355e7b02be req-8185d092-5399-41f9-919d-ca9b027e82a4 service nova] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1717b801-f282-47b6-ad0f-d3355e7b02be req-8185d092-5399-41f9-919d-ca9b027e82a4 service nova] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-1717b801-f282-47b6-ad0f-d3355e7b02be req-8185d092-5399-41f9-919d-ca9b027e82a4 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] No waiting events found dispatching network-vif-plugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:00:12 user nova-compute[75469]: WARNING nova.compute.manager [req-1717b801-f282-47b6-ad0f-d3355e7b02be req-8185d092-5399-41f9-919d-ca9b027e82a4 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Received unexpected event network-vif-plugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc for instance with vm_state building and task_state spawning.
Nov 14 05:00:12 user nova-compute[75469]: INFO nova.compute.manager [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 14 05:00:12 user nova-compute[75469]: DEBUG nova.compute.manager [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:00:12 user nova-compute[75469]: INFO nova.compute.manager [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Took 6.66 seconds to build instance.
Nov 14 05:00:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-12f50cb2-f08d-44a8-85ae-9d942c3b97b1 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.788s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "a48d1c5d-db49-4609-9ca4-21f4578d8943" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:00:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:21 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:00:21 user nova-compute[75469]: INFO nova.compute.claims [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Claim successful on node user
Nov 14 05:00:21 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:00:21 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:00:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:00:22 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:00:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG nova.policy [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a23a8feda3e4d7581666ca3ee20aa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e392b9dd841a4eacab6c4aff4f60e536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:00:22 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Creating image(s)
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "/opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "/opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "/opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.243s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.190s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk 1073741824" returned: 0 in 0.063s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Successfully created port: 0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.246s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Cannot resize image /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Ensure instance console log exists: /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Successfully updated port: 0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "refresh_cache-a48d1c5d-db49-4609-9ca4-21f4578d8943" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquired lock "refresh_cache-a48d1c5d-db49-4609-9ca4-21f4578d8943" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-f570f3a8-70d2-46bf-8d23-a4f2b3c3c80f req-3c4b59b2-319b-40a4-bd8c-501f3213f7ce service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Received event network-changed-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-f570f3a8-70d2-46bf-8d23-a4f2b3c3c80f req-3c4b59b2-319b-40a4-bd8c-501f3213f7ce service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Refreshing instance network info cache due to event network-changed-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f570f3a8-70d2-46bf-8d23-a4f2b3c3c80f req-3c4b59b2-319b-40a4-bd8c-501f3213f7ce service nova] Acquiring lock "refresh_cache-a48d1c5d-db49-4609-9ca4-21f4578d8943" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Updating instance_info_cache with network_info: [{"id": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "address": "fa:16:3e:4f:d1:31", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa47bcc-04", "ovs_interfaceid": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Releasing lock "refresh_cache-a48d1c5d-db49-4609-9ca4-21f4578d8943" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Instance network_info: |[{"id": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "address": "fa:16:3e:4f:d1:31", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa47bcc-04", "ovs_interfaceid": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f570f3a8-70d2-46bf-8d23-a4f2b3c3c80f req-3c4b59b2-319b-40a4-bd8c-501f3213f7ce service nova] Acquired lock "refresh_cache-a48d1c5d-db49-4609-9ca4-21f4578d8943" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-f570f3a8-70d2-46bf-8d23-a4f2b3c3c80f req-3c4b59b2-319b-40a4-bd8c-501f3213f7ce service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Refreshing network info cache for port 0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Start _get_guest_xml network_info=[{"id": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "address": "fa:16:3e:4f:d1:31", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa47bcc-04", "ovs_interfaceid": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:00:23 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:00:23 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-305368857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-305368857',id=25,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-hfauh5b3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:00:22Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=a48d1c5d-db49-4609-9ca4-21f4578d8943,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "address": "fa:16:3e:4f:d1:31", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa47bcc-04", "ovs_interfaceid": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "address": "fa:16:3e:4f:d1:31", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa47bcc-04", "ovs_interfaceid": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d1:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa47bcc-04') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:00:23 user nova-compute[75469]: DEBUG nova.objects.instance [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'pci_devices' on Instance uuid a48d1c5d-db49-4609-9ca4-21f4578d8943 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:00:24 user nova-compute[75469]:   <uuid>a48d1c5d-db49-4609-9ca4-21f4578d8943</uuid>
Nov 14 05:00:24 user nova-compute[75469]:   <name>instance-00000019</name>
Nov 14 05:00:24 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:00:24 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:00:24 user nova-compute[75469]:   <metadata>
Nov 14 05:00:24 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:00:24 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:00:24 user nova-compute[75469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-305368857</nova:name>
Nov 14 05:00:24 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:00:23</nova:creationTime>
Nov 14 05:00:24 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:00:24 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:00:24 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:00:24 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:00:24 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:00:24 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:00:24 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:00:24 user nova-compute[75469]:       <nova:owner>
Nov 14 05:00:24 user nova-compute[75469]:         <nova:user uuid="3a23a8feda3e4d7581666ca3ee20aa5f">tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member</nova:user>
Nov 14 05:00:24 user nova-compute[75469]:         <nova:project uuid="e392b9dd841a4eacab6c4aff4f60e536">tempest-ServerBootFromVolumeStableRescueTest-1634984639</nova:project>
Nov 14 05:00:24 user nova-compute[75469]:       </nova:owner>
Nov 14 05:00:24 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:00:24 user nova-compute[75469]:       <nova:ports>
Nov 14 05:00:24 user nova-compute[75469]:         <nova:port uuid="0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0">
Nov 14 05:00:24 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 05:00:24 user nova-compute[75469]:         </nova:port>
Nov 14 05:00:24 user nova-compute[75469]:       </nova:ports>
Nov 14 05:00:24 user nova-compute[75469]:     </nova:instance>
Nov 14 05:00:24 user nova-compute[75469]:   </metadata>
Nov 14 05:00:24 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:00:24 user nova-compute[75469]:     <system>
Nov 14 05:00:24 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:00:24 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:00:24 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:00:24 user nova-compute[75469]:       <entry name="serial">a48d1c5d-db49-4609-9ca4-21f4578d8943</entry>
Nov 14 05:00:24 user nova-compute[75469]:       <entry name="uuid">a48d1c5d-db49-4609-9ca4-21f4578d8943</entry>
Nov 14 05:00:24 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:00:24 user nova-compute[75469]:     </system>
Nov 14 05:00:24 user nova-compute[75469]:   </sysinfo>
Nov 14 05:00:24 user nova-compute[75469]:   <os>
Nov 14 05:00:24 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:00:24 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:00:24 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:00:24 user nova-compute[75469]:   </os>
Nov 14 05:00:24 user nova-compute[75469]:   <features>
Nov 14 05:00:24 user nova-compute[75469]:     <acpi/>
Nov 14 05:00:24 user nova-compute[75469]:     <apic/>
Nov 14 05:00:24 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:00:24 user nova-compute[75469]:   </features>
Nov 14 05:00:24 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:00:24 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:00:24 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:00:24 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:00:24 user nova-compute[75469]:   </clock>
Nov 14 05:00:24 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:00:24 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:00:24 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:00:24 user nova-compute[75469]:   </cpu>
Nov 14 05:00:24 user nova-compute[75469]:   <devices>
Nov 14 05:00:24 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:00:24 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:00:24 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk"/>
Nov 14 05:00:24 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:00:24 user nova-compute[75469]:     </disk>
Nov 14 05:00:24 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:00:24 user nova-compute[75469]:       <mac address="fa:16:3e:4f:d1:31"/>
Nov 14 05:00:24 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:00:24 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:00:24 user nova-compute[75469]:       <target dev="tap0aa47bcc-04"/>
Nov 14 05:00:24 user nova-compute[75469]:     </interface>
Nov 14 05:00:24 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:00:24 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/console.log" append="off"/>
Nov 14 05:00:24 user nova-compute[75469]:     </serial>
Nov 14 05:00:24 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:00:24 user nova-compute[75469]:     <video>
Nov 14 05:00:24 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:00:24 user nova-compute[75469]:     </video>
Nov 14 05:00:24 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:00:24 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:00:24 user nova-compute[75469]:     </rng>
Nov 14 05:00:24 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:00:24 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:00:24 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:00:24 user nova-compute[75469]:     </memballoon>
Nov 14 05:00:24 user nova-compute[75469]:   </devices>
Nov 14 05:00:24 user nova-compute[75469]: </domain>
Nov 14 05:00:24 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-305368857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-305368857',id=25,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-hfauh5b3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:00:22Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=a48d1c5d-db49-4609-9ca4-21f4578d8943,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "address": "fa:16:3e:4f:d1:31", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa47bcc-04", "ovs_interfaceid": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "address": "fa:16:3e:4f:d1:31", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa47bcc-04", "ovs_interfaceid": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d1:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa47bcc-04') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG os_vif [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d1:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa47bcc-04') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d5f709e-fcbd-5e72-9bb9-5edabe050c32', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0aa47bcc-04, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0aa47bcc-04, col_values=(('qos', UUID('9e6bc387-2123-49f8-ab31-211a1fd2d84e')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0aa47bcc-04, col_values=(('external_ids', {'iface-id': '0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:d1:31', 'vm-uuid': 'a48d1c5d-db49-4609-9ca4-21f4578d8943'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:24 user nova-compute[75469]: INFO os_vif [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d1:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa47bcc-04')
Nov 14 05:00:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No VIF found with MAC fa:16:3e:4f:d1:31, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG nova.network.neutron [req-f570f3a8-70d2-46bf-8d23-a4f2b3c3c80f req-3c4b59b2-319b-40a4-bd8c-501f3213f7ce service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Updated VIF entry in instance network info cache for port 0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG nova.network.neutron [req-f570f3a8-70d2-46bf-8d23-a4f2b3c3c80f req-3c4b59b2-319b-40a4-bd8c-501f3213f7ce service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Updating instance_info_cache with network_info: [{"id": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "address": "fa:16:3e:4f:d1:31", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa47bcc-04", "ovs_interfaceid": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:00:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f570f3a8-70d2-46bf-8d23-a4f2b3c3c80f req-3c4b59b2-319b-40a4-bd8c-501f3213f7ce service nova] Releasing lock "refresh_cache-a48d1c5d-db49-4609-9ca4-21f4578d8943" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:00:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-d354ada0-5b4f-467b-a26a-b21d2635d277 req-2de60a63-2a66-49f9-948f-cda636aab214 service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Received event network-vif-plugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d354ada0-5b4f-467b-a26a-b21d2635d277 req-2de60a63-2a66-49f9-948f-cda636aab214 service nova] Acquiring lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d354ada0-5b4f-467b-a26a-b21d2635d277 req-2de60a63-2a66-49f9-948f-cda636aab214 service nova] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d354ada0-5b4f-467b-a26a-b21d2635d277 req-2de60a63-2a66-49f9-948f-cda636aab214 service nova] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-d354ada0-5b4f-467b-a26a-b21d2635d277 req-2de60a63-2a66-49f9-948f-cda636aab214 service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] No waiting events found dispatching network-vif-plugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:00:25 user nova-compute[75469]: WARNING nova.compute.manager [req-d354ada0-5b4f-467b-a26a-b21d2635d277 req-2de60a63-2a66-49f9-948f-cda636aab214 service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Received unexpected event network-vif-plugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 for instance with vm_state building and task_state spawning.
Nov 14 05:00:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:00:27 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Instance spawned successfully.
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:00:27 user nova-compute[75469]: INFO nova.compute.manager [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:00:27 user nova-compute[75469]: INFO nova.compute.manager [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Took 6.31 seconds to build instance.
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-ee7c0c21-f242-4730-8dcf-7177fc435f3a req-c09e133f-1fee-48e8-a34c-a3a909eff237 service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Received event network-vif-plugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ee7c0c21-f242-4730-8dcf-7177fc435f3a req-c09e133f-1fee-48e8-a34c-a3a909eff237 service nova] Acquiring lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ee7c0c21-f242-4730-8dcf-7177fc435f3a req-c09e133f-1fee-48e8-a34c-a3a909eff237 service nova] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ee7c0c21-f242-4730-8dcf-7177fc435f3a req-c09e133f-1fee-48e8-a34c-a3a909eff237 service nova] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-ee7c0c21-f242-4730-8dcf-7177fc435f3a req-c09e133f-1fee-48e8-a34c-a3a909eff237 service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] No waiting events found dispatching network-vif-plugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:00:27 user nova-compute[75469]: WARNING nova.compute.manager [req-ee7c0c21-f242-4730-8dcf-7177fc435f3a req-c09e133f-1fee-48e8-a34c-a3a909eff237 service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Received unexpected event network-vif-plugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 for instance with vm_state active and task_state None.
Nov 14 05:00:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cfbf52ba-abf1-43ec-b978-56f9ef55fd14 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.403s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:29 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 708da3a8-c9ce-4d36-87f4-658756b11481 is timed out.
Nov 14 05:00:29 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Successfully detached device vdb from instance 708da3a8-c9ce-4d36-87f4-658756b11481 from the live domain config.
Nov 14 05:00:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyAXSIqa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:00:29 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b89616-401b-44d2-bc49-5de0d1a1cfca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:00:29 user nova-compute[75469]: No targets found.
Nov 14 05:00:29 user nova-compute[75469]: iSNS:
Nov 14 05:00:29 user nova-compute[75469]: No targets found.
Nov 14 05:00:29 user nova-compute[75469]: STATIC:
Nov 14 05:00:29 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869
Nov 14 05:00:29 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:29 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:29 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0
Nov 14 05:00:29 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:29 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:29 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188
Nov 14 05:00:29 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:29 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:29 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730
Nov 14 05:00:29 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:29 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:29 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:00:29 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:29 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:29 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef
Nov 14 05:00:29 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:29 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:29 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8
Nov 14 05:00:29 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:29 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:29 user nova-compute[75469]: FIRMWARE:
Nov 14 05:00:29 user nova-compute[75469]: No targets found.
Nov 14 05:00:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:00:29 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:00:29 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22a7978-c6ca-489f-8d70-ce6febfa34e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf9d9bc-2ed9-4843-aa81-a94adbc74774]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 (non-flash)
Nov 14 05:00:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c2976d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730'): ({'sdh'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Removing single pathed devices sdh {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[189a8e34-d6dc-45fd-a037-7725881c3a34]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a0533b-03c7-4d95-9566-f23ce2ed0e7f]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Flushing IO for device /dev/sdh {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b690b54f-175f-426d-9699-8c983a03e567]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb72509-dac4-4f9e-a8d8-cd461d527921]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] SCSI volumes sdh have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adbee0c-1cf5-4acb-a741-cbf1c4025817]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[10303db8-841f-4210-9522-f38c948fdad7]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730, portal: 172.16.0.220,3260]
Nov 14 05:00:29 user nova-compute[75469]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730, portal: 172.16.0.220,3260] successful.
Nov 14 05:00:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216395d2-05c6-426a-9342-57438ecbf730 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a186156b-9c6a-493c-a2a2-51c537991170]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] <== disconnect_volume: return (332ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:00:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:30 user nova-compute[75469]: INFO nova.compute.manager [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Terminating instance
Nov 14 05:00:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG nova.objects.instance [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lazy-loading 'flavor' on Instance uuid 708da3a8-c9ce-4d36-87f4-658756b11481 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6b6ebfde-7284-4642-976a-3db11dea4777 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.732s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-47a6556f-fbf0-4e7a-88c6-d54b35676833 req-1a4432b2-4078-4ae5-ae9a-33ee2338b192 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-47a6556f-fbf0-4e7a-88c6-d54b35676833 req-1a4432b2-4078-4ae5-ae9a-33ee2338b192 service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-47a6556f-fbf0-4e7a-88c6-d54b35676833 req-1a4432b2-4078-4ae5-ae9a-33ee2338b192 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-47a6556f-fbf0-4e7a-88c6-d54b35676833 req-1a4432b2-4078-4ae5-ae9a-33ee2338b192 service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-47a6556f-fbf0-4e7a-88c6-d54b35676833 req-1a4432b2-4078-4ae5-ae9a-33ee2338b192 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-47a6556f-fbf0-4e7a-88c6-d54b35676833 req-1a4432b2-4078-4ae5-ae9a-33ee2338b192 service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-unplugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:00:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Instance destroyed successfully.
Nov 14 05:00:30 user nova-compute[75469]: DEBUG nova.objects.instance [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lazy-loading 'resources' on Instance uuid fb551839-7b5a-4ecd-b9c0-ab53addeaa45 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-501716171',display_name='tempest-ServerActionsTestOtherB-server-501716171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-501716171',id=4,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCM9hFVe3wxoADlpmZS5pvsZqPL5+bIs5VB/4pYIHPJU3LZ6fFGC+bLXtjhSZVFtu7N4xdCrGz0UJgg9Kot0QzE0EwlPJEFb1NBTvEvGy/Q0Twm7zNyBzgTNIwdP75tUg==',key_name='tempest-keypair-1630737506',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a921fed4277644dd9b75295d99c4af6b',ramdisk_id='',reservation_id='r-4b5895c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1992991016',owner_user_name='tempest-ServerActionsTestOtherB-1992991016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c089065dec4fbdaf39807c43265ecf',uuid=fb551839-7b5a-4ecd-b9c0-ab53addeaa45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converting VIF {"id": "45923d58-4176-482f-b9c0-6f871c90529c", "address": "fa:16:3e:44:d1:3e", "network": {"id": "0536b460-9801-4159-92b8-f891eac9b694", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413052241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a921fed4277644dd9b75295d99c4af6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45923d58-41", "ovs_interfaceid": "45923d58-4176-482f-b9c0-6f871c90529c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG os_vif [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45923d58-41, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3c3fd3f-e70d-4a64-98d2-0e6ab5342303) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:00:30 user nova-compute[75469]: INFO os_vif [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d1:3e,bridge_name='br-int',has_traffic_filtering=True,id=45923d58-4176-482f-b9c0-6f871c90529c,network=Network(0536b460-9801-4159-92b8-f891eac9b694),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45923d58-41')
Nov 14 05:00:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knptGdZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:00:30 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:00:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ff5610-4ff4-4803-bf2c-5ab42ce00535]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:00:30 user nova-compute[75469]: No targets found.
Nov 14 05:00:30 user nova-compute[75469]: iSNS:
Nov 14 05:00:30 user nova-compute[75469]: No targets found.
Nov 14 05:00:30 user nova-compute[75469]: STATIC:
Nov 14 05:00:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869
Nov 14 05:00:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0
Nov 14 05:00:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188
Nov 14 05:00:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:00:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef
Nov 14 05:00:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8
Nov 14 05:00:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:00:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:00:30 user nova-compute[75469]: FIRMWARE:
Nov 14 05:00:30 user nova-compute[75469]: No targets found.
Nov 14 05:00:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:00:30 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:00:30 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[255ddc7e-a52b-4894-bda8-f93b064bd16f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1afd9c0-32f8-4092-a66f-52630ee5cf93]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:30 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 05:00:30 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:30 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:30 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:30 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:30 user nova-compute[75469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 (non-flash)
Nov 14 05:00:30 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:30 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:30 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:30 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c5fe320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188'): ({'sde'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Removing single pathed devices sde {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:00:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee04e9a-9f70-4580-aa14-95c35fbd7951]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[352b1949-0242-4f19-a87a-34ca7b30da1c]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Flushing IO for device /dev/sde {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f14aac3-aa05-4ee0-be7d-fbb0e1676546]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b10954-cd70-40df-863c-8ab9fe048870]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3c0199-138e-4ede-b416-8bfb98ff515d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f900f79-13c0-4df1-9ab7-f37a5eca771f]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260]
Nov 14 05:00:31 user nova-compute[75469]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188, portal: 172.16.0.220,3260] successful.
Nov 14 05:00:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc11541-4c2d-4184-bee8-29391718e188 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b6093d-6a2d-4ac4-94f8-9dba8856baee]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] <== disconnect_volume: return (348ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:00:31 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Deleting instance files /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45_del
Nov 14 05:00:31 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Deletion of /opt/stack/data/nova/instances/fb551839-7b5a-4ecd-b9c0-ab53addeaa45_del complete
Nov 14 05:00:31 user nova-compute[75469]: INFO nova.compute.manager [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 05:00:31 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:00:31 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:00:32 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:00:32 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Took 0.95 seconds to deallocate network for instance.
Nov 14 05:00:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-9ec283fa-6ff2-4223-a4c7-d7812cb6a258 req-232da6d7-5fb9-4e87-98b6-9c3267fc1b9a service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-deleted-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-5876537d-f5a1-44bd-bf97-d4b20dff7102 req-7ca75864-e903-452e-bd99-b50f7b208f4b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5876537d-f5a1-44bd-bf97-d4b20dff7102 req-7ca75864-e903-452e-bd99-b50f7b208f4b service nova] Acquiring lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5876537d-f5a1-44bd-bf97-d4b20dff7102 req-7ca75864-e903-452e-bd99-b50f7b208f4b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5876537d-f5a1-44bd-bf97-d4b20dff7102 req-7ca75864-e903-452e-bd99-b50f7b208f4b service nova] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-5876537d-f5a1-44bd-bf97-d4b20dff7102 req-7ca75864-e903-452e-bd99-b50f7b208f4b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] No waiting events found dispatching network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:00:32 user nova-compute[75469]: WARNING nova.compute.manager [req-5876537d-f5a1-44bd-bf97-d4b20dff7102 req-7ca75864-e903-452e-bd99-b50f7b208f4b service nova] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Received unexpected event network-vif-plugged-45923d58-4176-482f-b9c0-6f871c90529c for instance with vm_state active and task_state deleting.
Nov 14 05:00:33 user nova-compute[75469]: INFO nova.compute.manager [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] [instance: fb551839-7b5a-4ecd-b9c0-ab53addeaa45] Took 0.82 seconds to detach 1 volumes for instance.
Nov 14 05:00:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:33 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:00:33 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:00:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:33 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Deleted allocations for instance fb551839-7b5a-4ecd-b9c0-ab53addeaa45
Nov 14 05:00:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fe506af3-c621-4923-8027-f2a33f2d4ac7 tempest-ServerActionsTestOtherB-1992991016 tempest-ServerActionsTestOtherB-1992991016-project-member] Lock "fb551839-7b5a-4ecd-b9c0-ab53addeaa45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.692s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG nova.objects.instance [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'flavor' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:38 user nova-compute[75469]: INFO nova.compute.manager [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Attaching volume 63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 to /dev/vdb
Nov 14 05:00:38 user nova-compute[75469]: DEBUG os_brick.utils [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc3e1ea-1ea8-4004-bdc6-ef71ad4afaa5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f6338c-6172-4c15-95be-c915f41a6550]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[956aa911-6c1a-4628-9ee4-4f0429a166dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[431a15fd-7c32-44a2-a563-db7340dd2ac8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:00:38 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:00:38 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea681a69-6a45-42e6-a4c2-cc46a02b9f27]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG os_brick.utils [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:00:38 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updating existing volume attachment record: efc3b56e-1218-49ac-86a3-6f6b3778bab9 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:00:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:42 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:00:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkvZjMYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:00:42 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:00:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:00:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:00:42 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:00:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:00:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:00:42 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f0e7e5-dceb-4c75-98b9-f0f69fe6f1f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:00:43 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e1b0e6-fa5a-46fa-9505-a257509f63a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8] added
Nov 14 05:00:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d45ba6b-6c33-4ce0-b40f-9b9b7db8af7b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e3e590-d956-4e56-b732-b4219e7da5b2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkvZjMYS {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkvZjMYS" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8f2433-cf23-4b9d-a030-aa2da0cdd38b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gkvZjMYS'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a98a740-a167-4732-8e60-f15b27e4ef4f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e904450b-362b-4f42-8496-a6ece2ed29af]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b147f59-7b9f-4ed3-86f7-12116ffcd7eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8, portal: 172.16.0.220,3260]
Nov 14 05:00:43 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8, portal: 172.16.0.220,3260] successful.
Nov 14 05:00:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9e9080-8265-4612-8081-0685b7e6d67b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed7ae03-d2cd-4a94-9d8b-48e1d5cc7862]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:00:43 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00a5551-2591-422d-bf95-68091a59e088]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:43 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:00:44 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:00:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkvZjMYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:00:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:00:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23166623135383331', 'path': '/dev/sde'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:00:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166623135383331', 'path': '/dev/sde'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:00:44 user nova-compute[75469]: DEBUG nova.objects.instance [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'flavor' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:00:44 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:00:44 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:00:44 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:00:44 user nova-compute[75469]:   <serial>63bf98e0-5edb-4cfd-99bc-13c4e57c36b8</serial>
Nov 14 05:00:44 user nova-compute[75469]: </disk>
Nov 14 05:00:44 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:00:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:00:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:00:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] No VIF found with MAC fa:16:3e:a1:ee:ec, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:00:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23065454-428a-44d9-977b-61074b12ffb4 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.349s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:45 user nova-compute[75469]: INFO nova.compute.manager [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Rescuing
Nov 14 05:00:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:00:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquired lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:00:45 user nova-compute[75469]: DEBUG nova.network.neutron [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:00:45 user nova-compute[75469]: DEBUG nova.network.neutron [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updating instance_info_cache with network_info: [{"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:00:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Releasing lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:00:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-20adfe9f-2160-4f9b-b9bb-3c7e341974ca req-ce8aebfb-45c6-4185-994c-0cad989bb1c8 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-unplugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-20adfe9f-2160-4f9b-b9bb-3c7e341974ca req-ce8aebfb-45c6-4185-994c-0cad989bb1c8 service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-20adfe9f-2160-4f9b-b9bb-3c7e341974ca req-ce8aebfb-45c6-4185-994c-0cad989bb1c8 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-20adfe9f-2160-4f9b-b9bb-3c7e341974ca req-ce8aebfb-45c6-4185-994c-0cad989bb1c8 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-20adfe9f-2160-4f9b-b9bb-3c7e341974ca req-ce8aebfb-45c6-4185-994c-0cad989bb1c8 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-unplugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:00:46 user nova-compute[75469]: WARNING nova.compute.manager [req-20adfe9f-2160-4f9b-b9bb-3c7e341974ca req-ce8aebfb-45c6-4185-994c-0cad989bb1c8 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received unexpected event network-vif-unplugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with vm_state active and task_state rescuing.
Nov 14 05:00:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:46 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Instance destroyed successfully.
Nov 14 05:00:46 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Attempting a stable device rescue
Nov 14 05:00:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Instance directory exists: not creating {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 05:00:46 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Creating image(s)
Nov 14 05:00:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "/opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "/opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG nova.objects.instance [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'trusted_certs' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "9a053c1b0e214e48c9f8a022a2767cb27d70af07" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "9a053c1b0e214e48c9f8a022a2767cb27d70af07" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07.part --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07.part --force-share --output=json" returned: 0 in 0.206s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:47 user nova-compute[75469]: DEBUG nova.virt.images [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] ebd86566-b62a-4556-8a35-8b1d857c5886 was qcow2, converting to raw {{(pid=75469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 05:00:47 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 05:00:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07.part /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07.converted {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.compute.manager [req-d2254463-b6ce-4da2-9872-e426e224d958 req-177009c0-cc5f-4485-92a0-3a9a771ddc89 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d2254463-b6ce-4da2-9872-e426e224d958 req-177009c0-cc5f-4485-92a0-3a9a771ddc89 service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d2254463-b6ce-4da2-9872-e426e224d958 req-177009c0-cc5f-4485-92a0-3a9a771ddc89 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d2254463-b6ce-4da2-9872-e426e224d958 req-177009c0-cc5f-4485-92a0-3a9a771ddc89 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.compute.manager [req-d2254463-b6ce-4da2-9872-e426e224d958 req-177009c0-cc5f-4485-92a0-3a9a771ddc89 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:00:48 user nova-compute[75469]: WARNING nova.compute.manager [req-d2254463-b6ce-4da2-9872-e426e224d958 req-177009c0-cc5f-4485-92a0-3a9a771ddc89 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received unexpected event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with vm_state active and task_state rescuing.
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07.part /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07.converted" returned: 0 in 0.358s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07.converted --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "9a053c1b0e214e48c9f8a022a2767cb27d70af07" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.757s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "9a053c1b0e214e48c9f8a022a2767cb27d70af07" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "9a053c1b0e214e48c9f8a022a2767cb27d70af07" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07 --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07,backing_fmt=raw /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.rescue {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07,backing_fmt=raw /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.rescue" returned: 0 in 0.051s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "9a053c1b0e214e48c9f8a022a2767cb27d70af07" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'migration_context' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:48 user nova-compute[75469]: INFO nova.compute.manager [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Detaching volume a43a992e-b094-4204-9025-17f075f217ef
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.objects.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Object Instance<c0ca77d2-8353-4dfc-beed-ac479535b5ba> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Start _get_guest_xml network_info=[{"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "vif_mac": "fa:16:3e:a1:ee:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ebd86566-b62a-4556-8a35-8b1d857c5886', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'efc3b56e-1218-49ac-86a3-6f6b3778bab9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkvZjMYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'c0ca77d2-8353-4dfc-beed-ac479535b5ba', 'attached_at': '', 'detached_at': '', 'volume_id': '63bf98e0-5edb-4cfd-99bc-13c4e57c36b8', 'serial': '63bf98e0-5edb-4cfd-99bc-13c4e57c36b8'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'resources' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.objects.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Object Instance<c0ca77d2-8353-4dfc-beed-ac479535b5ba> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'numa_topology' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.objects.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Object Instance<c0ca77d2-8353-4dfc-beed-ac479535b5ba> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:00:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:00:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'vcpu_model' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.objects.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Object Instance<c0ca77d2-8353-4dfc-beed-ac479535b5ba> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkvZjMYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:00:48 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:00:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:00:48 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:00:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:00:48 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:00:48 user nova-compute[75469]: INFO nova.virt.block_device [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Attempting to driver detach volume a43a992e-b094-4204-9025-17f075f217ef from mountpoint /dev/vdb
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Attempting to detach device vdb from instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:00:48 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:00:48 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:00:48 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:00:48 user nova-compute[75469]:   <serial>a43a992e-b094-4204-9025-17f075f217ef</serial>
Nov 14 05:00:48 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:00:48 user nova-compute[75469]: </disk>
Nov 14 05:00:48 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fd1d7c-9dcf-4ac8-b5a4-ebf6747ab33c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gkvZjMYS\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 05:00:48 user nova-compute[75469]: node.name = iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8
Nov 14 05:00:48 user nova-compute[75469]: node.tpgt = -1
Nov 14 05:00:48 user nova-compute[75469]: node.startup = automatic
Nov 14 05:00:48 user nova-compute[75469]: node.leading_login = No
Nov 14 05:00:48 user nova-compute[75469]: iface.iscsi_ifacename = default
Nov 14 05:00:48 user nova-compute[75469]: iface.net_ifacename = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.ipaddress = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.prefix_len = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.hwaddress = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.transport_name = tcp
Nov 14 05:00:48 user nova-compute[75469]: iface.initiatorname = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.state = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.vlan_id = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.vlan_priority = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.vlan_state = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.iface_num = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.mtu = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.port = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.bootproto = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.subnet_mask = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.gateway = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.dhcp_alt_client_id = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.dhcp_dns = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.dhcp_learn_iqn = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.dhcp_vendor_id_state = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.dhcp_vendor_id = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.dhcp_slp_da = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.fragmentation = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.gratuitous_arp = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.incoming_forwarding = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.tos_state = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.tos = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.ttl = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.delayed_ack = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.tcp_nagle = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.tcp_wsf_state = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.tcp_wsf = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.tcp_timer_scale = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.tcp_timestamp = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.redirect = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.def_task_mgmt_timeout = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.header_digest = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.data_digest = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.immediate_data = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.initial_r2t = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.data_seq_inorder = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.data_pdu_inorder = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.erl = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.max_receive_data_len = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.first_burst_len = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.max_outstanding_r2t = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.max_burst_len = 0
Nov 14 05:00:48 user nova-compute[75469]: iface.chap_auth = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.bidi_chap = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.strict_login_compliance = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.discovery_auth = <empty>
Nov 14 05:00:48 user nova-compute[75469]: iface.discovery_logout = <empty>
Nov 14 05:00:48 user nova-compute[75469]: node.discovery_address = <empty>
Nov 14 05:00:48 user nova-compute[75469]: node.discovery_port = 0
Nov 14 05:00:48 user nova-compute[75469]: node.discovery_type = static
Nov 14 05:00:48 user nova-compute[75469]: node.session.initial_cmdsn = 0
Nov 14 05:00:48 user nova-compute[75469]: node.session.initial_login_retry_max = 8
Nov 14 05:00:48 user nova-compute[75469]: node.session.xmit_thread_priority = -20
Nov 14 05:00:48 user nova-compute[75469]: node.session.cmds_max = 128
Nov 14 05:00:48 user nova-compute[75469]: node.session.queue_depth = 32
Nov 14 05:00:48 user nova-compute[75469]: node.session.nr_sessions = 1
Nov 14 05:00:48 user nova-compute[75469]: node.session.auth.authmethod = CHAP
Nov 14 05:00:48 user nova-compute[75469]: node.session.auth.username = gkvZjMYS
Nov 14 05:00:48 user nova-compute[75469]: node.session.auth.password = ***
Nov 14 05:00:48 user nova-compute[75469]: node.session.auth.username_in = <empty>
Nov 14 05:00:48 user nova-compute[75469]: node.session.auth.password_in = <empty>
Nov 14 05:00:48 user nova-compute[75469]: node.session.auth.chap_algs = MD5
Nov 14 05:00:48 user nova-compute[75469]: node.session.timeo.replacement_timeout = 120
Nov 14 05:00:48 user nova-compute[75469]: node.session.err_timeo.abort_timeout = 15
Nov 14 05:00:48 user nova-compute[75469]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 05:00:48 user nova-compute[75469]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 05:00:48 user nova-compute[75469]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 05:00:48 user nova-compute[75469]: node.session.iscsi.FastAbort = Yes
Nov 14 05:00:48 user nova-compute[75469]: node.session.iscsi.InitialR2T = No
Nov 14 05:00:48 user nova-compute[75469]: node.session.iscsi.ImmediateData = Yes
Nov 14 05:00:48 user nova-compute[75469]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 05:00:48 user nova-compute[75469]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 05:00:48 user nova-compute[75469]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 05:00:48 user nova-compute[75469]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 05:00:48 user nova-compute[75469]: node.session.iscsi.MaxConnections = 1
Nov 14 05:00:48 user nova-compute[75469]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 05:00:48 user nova-compute[75469]: node.session.iscsi.ERL = 0
Nov 14 05:00:48 user nova-compute[75469]: node.session.scan = manual
Nov 14 05:00:48 user nova-compute[75469]: node.session.reopen_max = 0
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].address = 172.16.0.220
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].port = 3260
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].startup = manual
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].tcp.window_size = 524288
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].tcp.type_of_service = 0
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].timeo.logout_timeout = 15
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].timeo.login_timeout = 15
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].timeo.auth_timeout = 45
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].iscsi.DataDigest = None
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].iscsi.IFMarker = No
Nov 14 05:00:48 user nova-compute[75469]: node.conn[0].iscsi.OFMarker = No
Nov 14 05:00:48 user nova-compute[75469]: # END RECORD
Nov 14 05:00:48 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:48 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully detached device vdb from instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 from the persistent domain config.
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:00:48 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:00:48 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:00:48 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:00:48 user nova-compute[75469]:   <serial>a43a992e-b094-4204-9025-17f075f217ef</serial>
Nov 14 05:00:48 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:00:48 user nova-compute[75469]: </disk>
Nov 14 05:00:48 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a14dd8-7b72-49f6-9f1c-27c89aa9db81]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[43881448-59a0-416b-9b30-e0418f112046]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkvZjMYS {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkvZjMYS" returned: 0 in 0.037s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[16829b7c-554d-4a05-ac02-0b26c9d86c41]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gkvZjMYS'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad700b9-3d52-49f3-99a0-00c56717501b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0d95bc-3dc7-4869-9196-37389753fce3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:49 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:49 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:49 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:49 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:49 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:00:49 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:00:49 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:00:49 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:00:49 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:00:49 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:00:49 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:00:49 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.180s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] HCTL ('36', '0', '0', 0) found on session 29 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0624e299-1bdb-4926-867f-54ff6435071b]: (4, ('0 0 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Searching for a device in session 29 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkvZjMYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.206s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] <== connect_volume: return (208ms) {'type': 'block', 'scsi_wwn': '23166623135383331', 'path': '/dev/sde'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166623135383331', 'path': '/dev/sde'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-507385695',display_name='tempest-ServerStableDeviceRescueTest-server-507385695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-507385695',id=18,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1+oqJ9P3bJ6y3y5C3t27tL4Ym2PLlY6l+cjQK9mE7PE9A+RlQ7Gt4TEObvMcrKFh4CuugLIwEsNKlc182b2KNQ2YftDJe4jK9zJ+va2E7K+EFaHyRoGOtaoVfEeS4fzA==',key_name='tempest-keypair-1578813028',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a019d303cd8c4aaca04142c29797192f',ramdisk_id='',reservation_id='r-q4c5sspw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-40224201',owner_user_name='tempest-ServerStableDeviceRescueTest-40224201-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5082710327f40249242020afcfe1b62',uuid=c0ca77d2-8353-4dfc-beed-ac479535b5ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "vif_mac": "fa:16:3e:a1:ee:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Converting VIF {"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "vif_mac": "fa:16:3e:a1:ee:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ee:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf280bdb-b07e-4472-b87a-304b48127d7c,network=Network(2d30057a-3bb9-4010-befa-3f57b496f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf280bdb-b0') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.objects.instance [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'pci_devices' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.objects.base [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Object Instance<c0ca77d2-8353-4dfc-beed-ac479535b5ba> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:00:49 user nova-compute[75469]:   <uuid>c0ca77d2-8353-4dfc-beed-ac479535b5ba</uuid>
Nov 14 05:00:49 user nova-compute[75469]:   <name>instance-00000012</name>
Nov 14 05:00:49 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:00:49 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:00:49 user nova-compute[75469]:   <metadata>
Nov 14 05:00:49 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:00:49 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:00:49 user nova-compute[75469]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-507385695</nova:name>
Nov 14 05:00:49 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:00:48</nova:creationTime>
Nov 14 05:00:49 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:00:49 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:00:49 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:00:49 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:00:49 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:00:49 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:00:49 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:00:49 user nova-compute[75469]:       <nova:owner>
Nov 14 05:00:49 user nova-compute[75469]:         <nova:user uuid="b5082710327f40249242020afcfe1b62">tempest-ServerStableDeviceRescueTest-40224201-project-member</nova:user>
Nov 14 05:00:49 user nova-compute[75469]:         <nova:project uuid="a019d303cd8c4aaca04142c29797192f">tempest-ServerStableDeviceRescueTest-40224201</nova:project>
Nov 14 05:00:49 user nova-compute[75469]:       </nova:owner>
Nov 14 05:00:49 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:00:49 user nova-compute[75469]:       <nova:ports>
Nov 14 05:00:49 user nova-compute[75469]:         <nova:port uuid="bf280bdb-b07e-4472-b87a-304b48127d7c">
Nov 14 05:00:49 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 05:00:49 user nova-compute[75469]:         </nova:port>
Nov 14 05:00:49 user nova-compute[75469]:       </nova:ports>
Nov 14 05:00:49 user nova-compute[75469]:     </nova:instance>
Nov 14 05:00:49 user nova-compute[75469]:   </metadata>
Nov 14 05:00:49 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:00:49 user nova-compute[75469]:     <system>
Nov 14 05:00:49 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:00:49 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:00:49 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:00:49 user nova-compute[75469]:       <entry name="serial">c0ca77d2-8353-4dfc-beed-ac479535b5ba</entry>
Nov 14 05:00:49 user nova-compute[75469]:       <entry name="uuid">c0ca77d2-8353-4dfc-beed-ac479535b5ba</entry>
Nov 14 05:00:49 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:00:49 user nova-compute[75469]:     </system>
Nov 14 05:00:49 user nova-compute[75469]:   </sysinfo>
Nov 14 05:00:49 user nova-compute[75469]:   <os>
Nov 14 05:00:49 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:00:49 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:00:49 user nova-compute[75469]:   </os>
Nov 14 05:00:49 user nova-compute[75469]:   <features>
Nov 14 05:00:49 user nova-compute[75469]:     <acpi/>
Nov 14 05:00:49 user nova-compute[75469]:     <apic/>
Nov 14 05:00:49 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:00:49 user nova-compute[75469]:   </features>
Nov 14 05:00:49 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:00:49 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:00:49 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:00:49 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:00:49 user nova-compute[75469]:   </clock>
Nov 14 05:00:49 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:00:49 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:00:49 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:00:49 user nova-compute[75469]:   </cpu>
Nov 14 05:00:49 user nova-compute[75469]:   <devices>
Nov 14 05:00:49 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:00:49 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:00:49 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk"/>
Nov 14 05:00:49 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:00:49 user nova-compute[75469]:     </disk>
Nov 14 05:00:49 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:00:49 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:00:49 user nova-compute[75469]:       <source dev="/dev/sde"/>
Nov 14 05:00:49 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 05:00:49 user nova-compute[75469]:       <serial>63bf98e0-5edb-4cfd-99bc-13c4e57c36b8</serial>
Nov 14 05:00:49 user nova-compute[75469]:     </disk>
Nov 14 05:00:49 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:00:49 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:00:49 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.rescue"/>
Nov 14 05:00:49 user nova-compute[75469]:       <target dev="vdc" bus="virtio"/>
Nov 14 05:00:49 user nova-compute[75469]:       <boot order="1"/>
Nov 14 05:00:49 user nova-compute[75469]:     </disk>
Nov 14 05:00:49 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:00:49 user nova-compute[75469]:       <mac address="fa:16:3e:a1:ee:ec"/>
Nov 14 05:00:49 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:00:49 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:00:49 user nova-compute[75469]:       <target dev="tapbf280bdb-b0"/>
Nov 14 05:00:49 user nova-compute[75469]:     </interface>
Nov 14 05:00:49 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:00:49 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/console.log" append="off"/>
Nov 14 05:00:49 user nova-compute[75469]:     </serial>
Nov 14 05:00:49 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:00:49 user nova-compute[75469]:     <video>
Nov 14 05:00:49 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:00:49 user nova-compute[75469]:     </video>
Nov 14 05:00:49 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:00:49 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:00:49 user nova-compute[75469]:     </rng>
Nov 14 05:00:49 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:00:49 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:00:49 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:00:49 user nova-compute[75469]:     </memballoon>
Nov 14 05:00:49 user nova-compute[75469]:   </devices>
Nov 14 05:00:49 user nova-compute[75469]: </domain>
Nov 14 05:00:49 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:00:49 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Instance destroyed successfully.
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] No VIF found with MAC fa:16:3e:a1:ee:ec, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updating instance_info_cache with network_info: [{"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-68c68428-4d79-4dd7-94a1-9c05e5230a8a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:00:49 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG nova.compute.manager [req-f493456e-abc8-47df-97fe-1d61d6b4d7a4 req-d255a810-d987-49e2-9328-5b68ff73fc2f service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f493456e-abc8-47df-97fe-1d61d6b4d7a4 req-d255a810-d987-49e2-9328-5b68ff73fc2f service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f493456e-abc8-47df-97fe-1d61d6b4d7a4 req-d255a810-d987-49e2-9328-5b68ff73fc2f service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f493456e-abc8-47df-97fe-1d61d6b4d7a4 req-d255a810-d987-49e2-9328-5b68ff73fc2f service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:50 user nova-compute[75469]: DEBUG nova.compute.manager [req-f493456e-abc8-47df-97fe-1d61d6b4d7a4 req-d255a810-d987-49e2-9328-5b68ff73fc2f service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:00:50 user nova-compute[75469]: WARNING nova.compute.manager [req-f493456e-abc8-47df-97fe-1d61d6b4d7a4 req-d255a810-d987-49e2-9328-5b68ff73fc2f service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received unexpected event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with vm_state active and task_state rescuing.
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG nova.compute.manager [None req-275c18bd-f753-47e1-9306-20275ab03687 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-b1d343e9-02a4-4c2d-95cb-3a64ceb4d5b8 req-287235b1-3f4a-45c2-b462-b0fc945e4a31 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b1d343e9-02a4-4c2d-95cb-3a64ceb4d5b8 req-287235b1-3f4a-45c2-b462-b0fc945e4a31 service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b1d343e9-02a4-4c2d-95cb-3a64ceb4d5b8 req-287235b1-3f4a-45c2-b462-b0fc945e4a31 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b1d343e9-02a4-4c2d-95cb-3a64ceb4d5b8 req-287235b1-3f4a-45c2-b462-b0fc945e4a31 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-b1d343e9-02a4-4c2d-95cb-3a64ceb4d5b8 req-287235b1-3f4a-45c2-b462-b0fc945e4a31 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:00:52 user nova-compute[75469]: WARNING nova.compute.manager [req-b1d343e9-02a4-4c2d-95cb-3a64ceb4d5b8 req-287235b1-3f4a-45c2-b462-b0fc945e4a31 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received unexpected event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with vm_state active and task_state rescuing.
Nov 14 05:00:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:00:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:00:55 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:00:55 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7276MB free_disk=24.91970443725586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c0ca77d2-8353-4dfc-beed-ac479535b5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 708da3a8-c9ce-4d36-87f4-658756b11481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 1c1c2492-d197-4b70-a915-1c594f49f8c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance ff1ee641-8abc-4e0e-acfe-b48859a428da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6048e25b-b73e-4d63-9ce3-d230dbf76876 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a48d1c5d-db49-4609-9ca4-21f4578d8943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:00:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:00:56 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:00:56 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:00:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:00:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:00:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:00:57 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:00:57 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:00:57 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:01:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "708da3a8-c9ce-4d36-87f4-658756b11481" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:01 user nova-compute[75469]: INFO nova.compute.manager [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Terminating instance
Nov 14 05:01:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-52d7ec68-2955-4c86-9a6e-03bc8b5ce475 req-bd2b165f-a870-4a75-8c67-90ded94b87f0 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Received event network-vif-unplugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-52d7ec68-2955-4c86-9a6e-03bc8b5ce475 req-bd2b165f-a870-4a75-8c67-90ded94b87f0 service nova] Acquiring lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-52d7ec68-2955-4c86-9a6e-03bc8b5ce475 req-bd2b165f-a870-4a75-8c67-90ded94b87f0 service nova] Lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-52d7ec68-2955-4c86-9a6e-03bc8b5ce475 req-bd2b165f-a870-4a75-8c67-90ded94b87f0 service nova] Lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-52d7ec68-2955-4c86-9a6e-03bc8b5ce475 req-bd2b165f-a870-4a75-8c67-90ded94b87f0 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] No waiting events found dispatching network-vif-unplugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-52d7ec68-2955-4c86-9a6e-03bc8b5ce475 req-bd2b165f-a870-4a75-8c67-90ded94b87f0 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Received event network-vif-unplugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:01:01 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Instance destroyed successfully.
Nov 14 05:01:01 user nova-compute[75469]: DEBUG nova.objects.instance [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lazy-loading 'resources' on Instance uuid 708da3a8-c9ce-4d36-87f4-658756b11481 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:58:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1076659333',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1076659333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1076659',id=19,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiiIIB2rVvmID42UMPWNYeutQ1H5DSG3Y7OCV4E9+yy5mBOyDOmxgDhQPsyszfBABmjx4+uPEbvconyt2lAE6KWvQnqSKKh51Ml6Z4HotePU1XKstWiqF7QA8yT67lDTg==',key_name='tempest-keypair-1105485361',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db1ce6a2889c4e7892cedf0074e02a8e',ramdisk_id='',reservation_id='r-d8i93sav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1654385870',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e34deb5afff54a04905b7a67fef9a6c0',uuid=708da3a8-c9ce-4d36-87f4-658756b11481,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "address": "fa:16:3e:dc:92:d0", "network": {"id": "a0ea6d0c-3672-45ef-8b6d-252e834a4c8a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-207125075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db1ce6a2889c4e7892cedf0074e02a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9835e10-aa", "ovs_interfaceid": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Converting VIF {"id": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "address": "fa:16:3e:dc:92:d0", "network": {"id": "a0ea6d0c-3672-45ef-8b6d-252e834a4c8a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-207125075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db1ce6a2889c4e7892cedf0074e02a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9835e10-aa", "ovs_interfaceid": "c9835e10-aae6-469f-b1dc-7a6216a58e07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=c9835e10-aae6-469f-b1dc-7a6216a58e07,network=Network(a0ea6d0c-3672-45ef-8b6d-252e834a4c8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9835e10-aa') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG os_vif [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=c9835e10-aae6-469f-b1dc-7a6216a58e07,network=Network(a0ea6d0c-3672-45ef-8b6d-252e834a4c8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9835e10-aa') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9835e10-aa, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9c2d4b7-61c5-4f01-bbcb-db06b7ab57b4) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:01 user nova-compute[75469]: INFO os_vif [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=c9835e10-aae6-469f-b1dc-7a6216a58e07,network=Network(a0ea6d0c-3672-45ef-8b6d-252e834a4c8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9835e10-aa')
Nov 14 05:01:01 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Deleting instance files /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481_del
Nov 14 05:01:01 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Deletion of /opt/stack/data/nova/instances/708da3a8-c9ce-4d36-87f4-658756b11481_del complete
Nov 14 05:01:01 user nova-compute[75469]: INFO nova.compute.manager [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 05:01:02 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:01:02 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:01:02 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:01:02 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:02 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Took 0.70 seconds to deallocate network for instance.
Nov 14 05:01:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-0074e960-1f96-4b9c-bd9f-378e1d0bd964 req-568d2fc3-1f8b-4e7b-ab40-51b10f9fa5d3 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Received event network-vif-deleted-c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:02 user nova-compute[75469]: INFO nova.compute.manager [req-0074e960-1f96-4b9c-bd9f-378e1d0bd964 req-568d2fc3-1f8b-4e7b-ab40-51b10f9fa5d3 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Neutron deleted interface c9835e10-aae6-469f-b1dc-7a6216a58e07; detaching it from the instance and deleting it from the info cache
Nov 14 05:01:02 user nova-compute[75469]: DEBUG nova.network.neutron [req-0074e960-1f96-4b9c-bd9f-378e1d0bd964 req-568d2fc3-1f8b-4e7b-ab40-51b10f9fa5d3 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-0074e960-1f96-4b9c-bd9f-378e1d0bd964 req-568d2fc3-1f8b-4e7b-ab40-51b10f9fa5d3 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Detach interface failed, port_id=c9835e10-aae6-469f-b1dc-7a6216a58e07, reason: Instance 708da3a8-c9ce-4d36-87f4-658756b11481 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:01:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:03 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:01:03 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:01:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:03 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Deleted allocations for instance 708da3a8-c9ce-4d36-87f4-658756b11481
Nov 14 05:01:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-03f17670-290b-40c0-b92d-3726d28af292 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870 tempest-TestServerVolumeAttachScenarioOldVersion-1654385870-project-member] Lock "708da3a8-c9ce-4d36-87f4-658756b11481" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.092s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-09ccd22f-a73b-4cf1-9ed2-4d26ab591e17 req-64f0d919-9bb5-49b4-a6b8-098193315ec2 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Received event network-vif-plugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09ccd22f-a73b-4cf1-9ed2-4d26ab591e17 req-64f0d919-9bb5-49b4-a6b8-098193315ec2 service nova] Acquiring lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09ccd22f-a73b-4cf1-9ed2-4d26ab591e17 req-64f0d919-9bb5-49b4-a6b8-098193315ec2 service nova] Lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-09ccd22f-a73b-4cf1-9ed2-4d26ab591e17 req-64f0d919-9bb5-49b4-a6b8-098193315ec2 service nova] Lock "708da3a8-c9ce-4d36-87f4-658756b11481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-09ccd22f-a73b-4cf1-9ed2-4d26ab591e17 req-64f0d919-9bb5-49b4-a6b8-098193315ec2 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] No waiting events found dispatching network-vif-plugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:03 user nova-compute[75469]: WARNING nova.compute.manager [req-09ccd22f-a73b-4cf1-9ed2-4d26ab591e17 req-64f0d919-9bb5-49b4-a6b8-098193315ec2 service nova] [instance: 708da3a8-c9ce-4d36-87f4-658756b11481] Received unexpected event network-vif-plugged-c9835e10-aae6-469f-b1dc-7a6216a58e07 for instance with vm_state deleted and task_state None.
Nov 14 05:01:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-63ce4b09-307f-43d6-867f-87ed982f1c64 req-2da6daac-9180-433e-9e94-768a4b4b319f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-changed-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-63ce4b09-307f-43d6-867f-87ed982f1c64 req-2da6daac-9180-433e-9e94-768a4b4b319f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing instance network info cache due to event network-changed-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:01:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-63ce4b09-307f-43d6-867f-87ed982f1c64 req-2da6daac-9180-433e-9e94-768a4b4b319f service nova] Acquiring lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:01:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-63ce4b09-307f-43d6-867f-87ed982f1c64 req-2da6daac-9180-433e-9e94-768a4b4b319f service nova] Acquired lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:01:07 user nova-compute[75469]: DEBUG nova.network.neutron [req-63ce4b09-307f-43d6-867f-87ed982f1c64 req-2da6daac-9180-433e-9e94-768a4b4b319f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Refreshing network info cache for port ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:01:07 user nova-compute[75469]: DEBUG nova.network.neutron [req-63ce4b09-307f-43d6-867f-87ed982f1c64 req-2da6daac-9180-433e-9e94-768a4b4b319f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updated VIF entry in instance network info cache for port ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:01:07 user nova-compute[75469]: DEBUG nova.network.neutron [req-63ce4b09-307f-43d6-867f-87ed982f1c64 req-2da6daac-9180-433e-9e94-768a4b4b319f service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [{"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78b07ae1-d554-41be-935f-3679ac796e28", "address": "fa:16:3e:b0:f4:b4", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07ae1-d5", "ovs_interfaceid": "78b07ae1-d554-41be-935f-3679ac796e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-63ce4b09-307f-43d6-867f-87ed982f1c64 req-2da6daac-9180-433e-9e94-768a4b4b319f service nova] Releasing lock "refresh_cache-1c1c2492-d197-4b70-a915-1c594f49f8c1" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-7423f8a8-9eec-4963-a471-8fc35a5d613f req-7d5c105a-3490-4c2f-8da0-bf62c4728022 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-changed-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-7423f8a8-9eec-4963-a471-8fc35a5d613f req-7d5c105a-3490-4c2f-8da0-bf62c4728022 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Refreshing instance network info cache due to event network-changed-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7423f8a8-9eec-4963-a471-8fc35a5d613f req-7d5c105a-3490-4c2f-8da0-bf62c4728022 service nova] Acquiring lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7423f8a8-9eec-4963-a471-8fc35a5d613f req-7d5c105a-3490-4c2f-8da0-bf62c4728022 service nova] Acquired lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-7423f8a8-9eec-4963-a471-8fc35a5d613f req-7d5c105a-3490-4c2f-8da0-bf62c4728022 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Refreshing network info cache for port c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:01:09 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 is timed out.
Nov 14 05:01:09 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully detached device vdb from instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 from the live domain config.
Nov 14 05:01:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlDHeWoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:01:09 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d6061d-7798-47ef-9582-9254e5955c2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:01:09 user nova-compute[75469]: No targets found.
Nov 14 05:01:09 user nova-compute[75469]: iSNS:
Nov 14 05:01:09 user nova-compute[75469]: No targets found.
Nov 14 05:01:09 user nova-compute[75469]: STATIC:
Nov 14 05:01:09 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869
Nov 14 05:01:09 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:09 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:09 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0
Nov 14 05:01:09 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:09 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:09 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8
Nov 14 05:01:09 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:09 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:09 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:01:09 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:09 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:09 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef
Nov 14 05:01:09 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:09 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:09 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8
Nov 14 05:01:09 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:09 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:09 user nova-compute[75469]: FIRMWARE:
Nov 14 05:01:09 user nova-compute[75469]: No targets found.
Nov 14 05:01:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:01:09 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:01:09 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c47f06-bfb0-410c-8f68-1896e0ea41ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[53985ad4-c9f3-4610-a165-343b989469fc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:09 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:01:09 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:01:09 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:01:09 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:01:09 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:09 user nova-compute[75469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef (non-flash)
Nov 14 05:01:09 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:01:09 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:01:09 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:01:09 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa74c2fce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c478600-e7e6-4edd-a461-6a54a4565777]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2010686a-3ad4-4b78-893b-4dad4c97a05e]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc8984f-2286-4fc5-9088-1c464a40f93a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa79fbd9-49ee-4dbb-9a6a-43c2a8c58d5b]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbc2beb-dbfb-4985-b81d-f124ec67b88a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec22b6db-fb13-4d8b-939b-46e650b7d33e]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef, portal: 172.16.0.220,3260]
Nov 14 05:01:09 user nova-compute[75469]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef, portal: 172.16.0.220,3260] successful.
Nov 14 05:01:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a43a992e-b094-4204-9025-17f075f217ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[062329cb-8339-4b1c-9303-09cb5aee7208]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] <== disconnect_volume: return (322ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:09 user nova-compute[75469]: INFO nova.compute.manager [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Terminating instance
Nov 14 05:01:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-7423f8a8-9eec-4963-a471-8fc35a5d613f req-7d5c105a-3490-4c2f-8da0-bf62c4728022 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updated VIF entry in instance network info cache for port c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-7423f8a8-9eec-4963-a471-8fc35a5d613f req-7d5c105a-3490-4c2f-8da0-bf62c4728022 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updating instance_info_cache with network_info: [{"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7423f8a8-9eec-4963-a471-8fc35a5d613f req-7d5c105a-3490-4c2f-8da0-bf62c4728022 service nova] Releasing lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-761e6450-a88b-4d61-b3be-75be38befe06 req-8fb44213-eb5f-4fd9-baa5-d572412a03c7 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-761e6450-a88b-4d61-b3be-75be38befe06 req-8fb44213-eb5f-4fd9-baa5-d572412a03c7 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-761e6450-a88b-4d61-b3be-75be38befe06 req-8fb44213-eb5f-4fd9-baa5-d572412a03c7 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-761e6450-a88b-4d61-b3be-75be38befe06 req-8fb44213-eb5f-4fd9-baa5-d572412a03c7 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-761e6450-a88b-4d61-b3be-75be38befe06 req-8fb44213-eb5f-4fd9-baa5-d572412a03c7 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-unplugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-761e6450-a88b-4d61-b3be-75be38befe06 req-8fb44213-eb5f-4fd9-baa5-d572412a03c7 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG nova.objects.instance [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'flavor' on Instance uuid 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-073f7a62-3e25-4666-b238-2fd85a3a15d5 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.049s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-92591c00-78d2-4b18-b52d-c054eb5f2636 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-unplugged-92591c00-78d2-4b18-b52d-c054eb5f2636 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-92591c00-78d2-4b18-b52d-c054eb5f2636 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-92591c00-78d2-4b18-b52d-c054eb5f2636 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-92591c00-78d2-4b18-b52d-c054eb5f2636 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:11 user nova-compute[75469]: WARNING nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-92591c00-78d2-4b18-b52d-c054eb5f2636 for instance with vm_state active and task_state deleting.
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-unplugged-78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-78b07ae1-d554-41be-935f-3679ac796e28 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:11 user nova-compute[75469]: WARNING nova.compute.manager [req-0a2db510-9d29-4401-a188-5e060e15709e req-2e00c623-8334-4532-825c-e8f7399bcdf8 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-78b07ae1-d554-41be-935f-3679ac796e28 for instance with vm_state active and task_state deleting.
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Instance destroyed successfully.
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.objects.instance [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lazy-loading 'resources' on Instance uuid 1c1c2492-d197-4b70-a915-1c594f49f8c1 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:59:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:9b:df,bridge_name='br-int',has_traffic_filtering=True,id=ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2,network=Network(58e00b8d-9e28-481c-9034-2d799599ac92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8439ae-cc') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:9b:df,bridge_name='br-int',has_traffic_filtering=True,id=ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2,network=Network(58e00b8d-9e28-481c-9034-2d799599ac92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8439ae-cc') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba8439ae-cc, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14092f25-5124-4556-8c04-2caf6d8dcd46) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: INFO os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:9b:df,bridge_name='br-int',has_traffic_filtering=True,id=ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2,network=Network(58e00b8d-9e28-481c-9034-2d799599ac92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8439ae-cc')
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:59:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:96:29,bridge_name='br-int',has_traffic_filtering=True,id=04007ea0-4889-41fc-9716-05d8b8889b8b,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04007ea0-48') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:96:29,bridge_name='br-int',has_traffic_filtering=True,id=04007ea0-4889-41fc-9716-05d8b8889b8b,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04007ea0-48') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:11 user nova-compute[75469]: INFO nova.compute.manager [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Shelving
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04007ea0-48, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97b2d8c3-435b-4d74-bd76-e6284cddc943) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: INFO os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:96:29,bridge_name='br-int',has_traffic_filtering=True,id=04007ea0-4889-41fc-9716-05d8b8889b8b,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04007ea0-48')
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:59:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:c4:4d,bridge_name='br-int',has_traffic_filtering=True,id=92591c00-78d2-4b18-b52d-c054eb5f2636,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92591c00-78') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c4:4d,bridge_name='br-int',has_traffic_filtering=True,id=92591c00-78d2-4b18-b52d-c054eb5f2636,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92591c00-78') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92591c00-78, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6848dabc-7115-46f4-8bee-2b65fdc7e24d) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: INFO os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c4:4d,bridge_name='br-int',has_traffic_filtering=True,id=92591c00-78d2-4b18-b52d-c054eb5f2636,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92591c00-78')
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:59:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=15a53d99-f268-49f0-8ffb-14f1dbfc5a3a,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a53d99-f2') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=15a53d99-f268-49f0-8ffb-14f1dbfc5a3a,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a53d99-f2') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15a53d99-f2, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=360ed1ae-2315-4160-aeb4-24becf13d3d6) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:12 user nova-compute[75469]: WARNING nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 for instance with vm_state active and task_state deleting.
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-04007ea0-4889-41fc-9716-05d8b8889b8b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-unplugged-04007ea0-4889-41fc-9716-05d8b8889b8b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-04007ea0-4889-41fc-9716-05d8b8889b8b for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-04007ea0-4889-41fc-9716-05d8b8889b8b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-04007ea0-4889-41fc-9716-05d8b8889b8b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:12 user nova-compute[75469]: WARNING nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-04007ea0-4889-41fc-9716-05d8b8889b8b for instance with vm_state active and task_state deleting.
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-unplugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:12 user nova-compute[75469]: WARNING nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a for instance with vm_state active and task_state deleting.
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-unplugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:12 user nova-compute[75469]: WARNING nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-cc63a63d-99d0-4fb8-9e21-182471a8b35f for instance with vm_state active and task_state deleting.
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-unplugged-6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-unplugged-6f39315a-307d-4436-bdd6-fed7197dfb5e for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-plugged-6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Acquiring lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] No waiting events found dispatching network-vif-plugged-6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:12 user nova-compute[75469]: WARNING nova.compute.manager [req-74a02a27-84cb-4165-b645-def6b67c0eba req-4419361b-c661-44b2-b1af-85e9708f1d36 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received unexpected event network-vif-plugged-6f39315a-307d-4436-bdd6-fed7197dfb5e for instance with vm_state active and task_state deleting.
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: INFO os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=15a53d99-f268-49f0-8ffb-14f1dbfc5a3a,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a53d99-f2')
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:59:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78b07ae1-d554-41be-935f-3679ac796e28", "address": "fa:16:3e:b0:f4:b4", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07ae1-d5", "ovs_interfaceid": "78b07ae1-d554-41be-935f-3679ac796e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "78b07ae1-d554-41be-935f-3679ac796e28", "address": "fa:16:3e:b0:f4:b4", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78b07ae1-d5", "ovs_interfaceid": "78b07ae1-d554-41be-935f-3679ac796e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=78b07ae1-d554-41be-935f-3679ac796e28,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07ae1-d5') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=78b07ae1-d554-41be-935f-3679ac796e28,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07ae1-d5') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78b07ae1-d5, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f506f30-d98c-4266-be4e-8181d39d3703) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Instance destroyed successfully.
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: INFO os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=78b07ae1-d554-41be-935f-3679ac796e28,network=Network(c4028c7e-bbdd-4bae-95e1-5ce3442dc133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78b07ae1-d5')
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:59:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f4:62,bridge_name='br-int',has_traffic_filtering=True,id=cc63a63d-99d0-4fb8-9e21-182471a8b35f,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc63a63d-99') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f4:62,bridge_name='br-int',has_traffic_filtering=True,id=cc63a63d-99d0-4fb8-9e21-182471a8b35f,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc63a63d-99') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc63a63d-99, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8fbf0983-20a0-4bcc-ad38-d1265748e2bf) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Beginning cold snapshot process
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: INFO os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f4:62,bridge_name='br-int',has_traffic_filtering=True,id=cc63a63d-99d0-4fb8-9e21-182471a8b35f,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc63a63d-99')
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T04:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1365694530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1365694530',id=21,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzotVzDjKLXHpw75kqoT8n/X0oPPunlQ/wk40Hhn5epQLTRHVB3BL3QbLtUUv9xPSiYL1UDyKmuYr75UWfuwCToOu9AEJb5HtwdugxBgT8Hnr8MwkayE0Hr1wly5ESyfQ==',key_name='tempest-keypair-723034360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70cd39bf8e024388913a7ec12bd911f7',ramdisk_id='',reservation_id='r-uvswg9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1408161910',owner_user_name='tempest-TaggedBootDevicesTest-1408161910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:59:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61868d69adcb4fa88dee243a3c7ebd5e',uuid=1c1c2492-d197-4b70-a915-1c594f49f8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converting VIF {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f39315a-307d-4436-bdd6-fed7197dfb5e,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39315a-30') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f39315a-307d-4436-bdd6-fed7197dfb5e,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39315a-30') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f39315a-30, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d88b49c4-a327-4e16-be58-3cf0d58618c8) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:12 user nova-compute[75469]: INFO os_vif [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f39315a-307d-4436-bdd6-fed7197dfb5e,network=Network(e599de61-b81b-469c-af53-b0ebfaf7a6f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39315a-30')
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heAVNJnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:01:12 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0383673a-581a-4be4-8e26-8e0ad4724fb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:01:12 user nova-compute[75469]: No targets found.
Nov 14 05:01:12 user nova-compute[75469]: iSNS:
Nov 14 05:01:12 user nova-compute[75469]: No targets found.
Nov 14 05:01:12 user nova-compute[75469]: STATIC:
Nov 14 05:01:12 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869
Nov 14 05:01:12 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:12 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:12 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0
Nov 14 05:01:12 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:12 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:12 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8
Nov 14 05:01:12 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:12 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:12 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:01:12 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:12 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:12 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8
Nov 14 05:01:12 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:12 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:12 user nova-compute[75469]: FIRMWARE:
Nov 14 05:01:12 user nova-compute[75469]: No targets found.
Nov 14 05:01:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:01:12 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:01:12 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd49cb7-23d4-46f6-b203-d09884111625]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2300689e-49a2-437c-b8c5-bb745edae622]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa758f8de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869'): ({'sdd'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Removing single pathed devices sdd {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9be459-d105-4c39-b58b-a6bfc7ae1eea]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk /opt/stack/data/nova/instances/snapshots/tmp7czxcoqn/a6fd53993a45448b80ae6ee4dbdab213 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4336a4be-4c6a-45f3-8b9b-857155ff0a4e]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Flushing IO for device /dev/sdd {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfd7fa7-51e3-4a1e-bd3d-e93c558427ae]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[84af0f39-f004-45a2-bf42-9cf7899e9416]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a30bea-f1c3-4877-b80b-9ba155eb559b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --logout" returned: 0 in 0.106s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7e32ce-3c6f-480e-9288-327d22b5c1e9]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869, portal: 172.16.0.220,3260]
Nov 14 05:01:12 user nova-compute[75469]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869, portal: 172.16.0.220,3260] successful.
Nov 14 05:01:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:245e075c-01ef-422e-8692-10286c8c8869 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76d7bb1-3097-4e33-9155-e537d698904f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.462s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] <== disconnect_volume: return (463ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHOlwLNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:01:12 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a831b6-e392-4fa4-8571-27cf2705ea8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:01:12 user nova-compute[75469]: No targets found.
Nov 14 05:01:12 user nova-compute[75469]: iSNS:
Nov 14 05:01:12 user nova-compute[75469]: No targets found.
Nov 14 05:01:12 user nova-compute[75469]: STATIC:
Nov 14 05:01:12 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0
Nov 14 05:01:12 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:12 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:12 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8
Nov 14 05:01:12 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:12 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:12 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:01:12 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:12 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:12 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8
Nov 14 05:01:12 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:12 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:12 user nova-compute[75469]: FIRMWARE:
Nov 14 05:01:12 user nova-compute[75469]: No targets found.
Nov 14 05:01:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:01:12 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:01:12 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[468f5c42-d330-4a0b-8786-0e3f89375e5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d47772a-0b27-432d-ae9d-151e970e1778]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa758f8de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8'): ({'sdf'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Removing single pathed devices sdf {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f6662a-feb3-4071-8817-00ea68965bff]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2ae2e9-d08c-480b-974d-530d85d55fb9]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Flushing IO for device /dev/sdf {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:01:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[86624fe4-1291-40ae-9d04-22a9b865aa07]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2752d08a-fc95-4f11-8552-7e0e7994c3ef]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] SCSI volumes sdf have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cba90e-e109-44e9-9928-c24a2116e353]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18c16db-30ef-4b57-965b-f18ce68d2c8f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8, portal: 172.16.0.220,3260]
Nov 14 05:01:13 user nova-compute[75469]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8, portal: 172.16.0.220,3260] successful.
Nov 14 05:01:13 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk /opt/stack/data/nova/instances/snapshots/tmp7czxcoqn/a6fd53993a45448b80ae6ee4dbdab213" returned: 0 in 0.648s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Snapshot extracted, beginning image upload
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e65207ba-20f7-4da4-b9f0-1d37051252f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac84fad-4c99-4467-b1e9-7821215328d1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] <== disconnect_volume: return (355ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLxbgndM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:01:13 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1fd060-c7dc-4f1b-af98-dfd2374190fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:01:13 user nova-compute[75469]: No targets found.
Nov 14 05:01:13 user nova-compute[75469]: iSNS:
Nov 14 05:01:13 user nova-compute[75469]: No targets found.
Nov 14 05:01:13 user nova-compute[75469]: STATIC:
Nov 14 05:01:13 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0
Nov 14 05:01:13 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:13 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:13 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8
Nov 14 05:01:13 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:13 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:13 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:01:13 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:01:13 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:01:13 user nova-compute[75469]: FIRMWARE:
Nov 14 05:01:13 user nova-compute[75469]: No targets found.
Nov 14 05:01:13 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:01:13 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:01:13 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb96b384-fe48-48a4-8705-47dc48978a61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f5dec9-d88b-452b-8322-88536884329b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:13 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:01:13 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:13 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:13 user nova-compute[75469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 (non-flash)
Nov 14 05:01:13 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:13 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa758f8de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0'): ({'sdg'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Removing single pathed devices sdg {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ad21df-e2ee-45c1-8ef0-a141efe2e9fc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a009237b-a5e7-4b1e-835d-8327ea282997]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Flushing IO for device /dev/sdg {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9859fabd-161f-427c-b10c-3a9584eb4fe3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c229f66a-6dad-48e1-89f9-ae0b99c2dd42]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] SCSI volumes sdg have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-vif-unplugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] No waiting events found dispatching network-vif-unplugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:13 user nova-compute[75469]: WARNING nova.compute.manager [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received unexpected event network-vif-unplugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 05:01:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] No waiting events found dispatching network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:13 user nova-compute[75469]: WARNING nova.compute.manager [req-c2841836-523a-40f7-9048-4941129e83a0 req-e7cbb9ba-a50d-450c-9362-5a41a090399f service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received unexpected event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bad8f13-a54e-4ab5-abf1-652fe0d1fefb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[094df104-e10d-4993-b234-2b3cb1a577fd]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0, portal: 172.16.0.220,3260]
Nov 14 05:01:13 user nova-compute[75469]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0, portal: 172.16.0.220,3260] successful.
Nov 14 05:01:13 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f10f1e7-5174-4160-a6dc-c4bbf65f93d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceff9a4-daee-466a-986b-541e9603879b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] <== disconnect_volume: return (301ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:01:13 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Deleting instance files /opt/stack/data/nova/instances/1c1c2492-d197-4b70-a915-1c594f49f8c1_del
Nov 14 05:01:13 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Deletion of /opt/stack/data/nova/instances/1c1c2492-d197-4b70-a915-1c594f49f8c1_del complete
Nov 14 05:01:13 user nova-compute[75469]: INFO nova.compute.manager [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Took 3.84 seconds to destroy the instance on the hypervisor.
Nov 14 05:01:13 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:01:13 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:01:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-347b4552-0ae8-4e92-b9e0-fe6e61080b03 req-c18b48b4-b182-49fb-9b0a-805397acf925 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-deleted-78b07ae1-d554-41be-935f-3679ac796e28 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:15 user nova-compute[75469]: INFO nova.compute.manager [req-347b4552-0ae8-4e92-b9e0-fe6e61080b03 req-c18b48b4-b182-49fb-9b0a-805397acf925 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Neutron deleted interface 78b07ae1-d554-41be-935f-3679ac796e28; detaching it from the instance and deleting it from the info cache
Nov 14 05:01:15 user nova-compute[75469]: DEBUG nova.network.neutron [req-347b4552-0ae8-4e92-b9e0-fe6e61080b03 req-c18b48b4-b182-49fb-9b0a-805397acf925 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [{"id": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "address": "fa:16:3e:d3:9b:df", "network": {"id": "58e00b8d-9e28-481c-9034-2d799599ac92", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1479770497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8439ae-cc", "ovs_interfaceid": "ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-347b4552-0ae8-4e92-b9e0-fe6e61080b03 req-c18b48b4-b182-49fb-9b0a-805397acf925 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Detach interface failed, port_id=78b07ae1-d554-41be-935f-3679ac796e28, reason: Instance 1c1c2492-d197-4b70-a915-1c594f49f8c1 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:01:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Snapshot image upload complete
Nov 14 05:01:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:01:15 user nova-compute[75469]: INFO nova.compute.manager [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Shelve offloading
Nov 14 05:01:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Instance destroyed successfully.
Nov 14 05:01:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:01:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:01:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquired lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:01:15 user nova-compute[75469]: DEBUG nova.network.neutron [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:01:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updating instance_info_cache with network_info: [{"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Releasing lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-deleted-ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:17 user nova-compute[75469]: INFO nova.compute.manager [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Neutron deleted interface ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2; detaching it from the instance and deleting it from the info cache
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [{"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "address": "fa:16:3e:2b:7b:a1", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a53d99-f2", "ovs_interfaceid": "15a53d99-f268-49f0-8ffb-14f1dbfc5a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Detach interface failed, port_id=ba8439ae-ccb3-4020-8bb4-1d4c079c8fb2, reason: Instance 1c1c2492-d197-4b70-a915-1c594f49f8c1 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-deleted-15a53d99-f268-49f0-8ffb-14f1dbfc5a3a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:17 user nova-compute[75469]: INFO nova.compute.manager [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Neutron deleted interface 15a53d99-f268-49f0-8ffb-14f1dbfc5a3a; detaching it from the instance and deleting it from the info cache
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [{"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "address": "fa:16:3e:f2:f4:62", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc63a63d-99", "ovs_interfaceid": "cc63a63d-99d0-4fb8-9e21-182471a8b35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Detach interface failed, port_id=15a53d99-f268-49f0-8ffb-14f1dbfc5a3a, reason: Instance 1c1c2492-d197-4b70-a915-1c594f49f8c1 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-deleted-cc63a63d-99d0-4fb8-9e21-182471a8b35f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:17 user nova-compute[75469]: INFO nova.compute.manager [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Neutron deleted interface cc63a63d-99d0-4fb8-9e21-182471a8b35f; detaching it from the instance and deleting it from the info cache
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [{"id": "04007ea0-4889-41fc-9716-05d8b8889b8b", "address": "fa:16:3e:f1:96:29", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04007ea0-48", "ovs_interfaceid": "04007ea0-4889-41fc-9716-05d8b8889b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92591c00-78d2-4b18-b52d-c054eb5f2636", "address": "fa:16:3e:01:c4:4d", "network": {"id": "c4028c7e-bbdd-4bae-95e1-5ce3442dc133", "bridge": "br-int", "label": "tempest-device-tagging-net1-962141705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92591c00-78", "ovs_interfaceid": "92591c00-78d2-4b18-b52d-c054eb5f2636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "address": "fa:16:3e:51:45:ef", "network": {"id": "e599de61-b81b-469c-af53-b0ebfaf7a6f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-92183407", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70cd39bf8e024388913a7ec12bd911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39315a-30", "ovs_interfaceid": "6f39315a-307d-4436-bdd6-fed7197dfb5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-4e3845bd-6413-49cd-9154-8e9475c0bc68 req-696f968f-3d4f-417f-9488-438f8eaa506b service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Detach interface failed, port_id=cc63a63d-99d0-4fb8-9e21-182471a8b35f, reason: Instance 1c1c2492-d197-4b70-a915-1c594f49f8c1 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:17 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Instance destroyed successfully.
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.objects.instance [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'resources' on Instance uuid ff1ee641-8abc-4e0e-acfe-b48859a428da {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:59:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-365164676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-365164676',id=22,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSQD5bSfa6qdQEhwI0KK41rmx99sGIX2msv5MKh6/gRf59kjIsdfgHdVcu1dd5V/7yhtWKba787Gpp7+nUIS8kVdxt6A0/wjwfuOwzT00jhB6IpMWMYgl0xCInO61eY4g==',key_name='tempest-keypair-757025621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-a50r03tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member',shelved_at='2023-11-14T05:01:15.849344',shelved_host='user',shelved_image_id='44dc6d56-4768-4a35-bb08-ea848614a458'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=ff1ee641-8abc-4e0e-acfe-b48859a428da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG os_vif [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3e0b05c-1e, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35b4bb5f-68bf-44ed-b928-58ce93ccc467) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:17 user nova-compute[75469]: INFO os_vif [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e')
Nov 14 05:01:17 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Deleting instance files /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da_del
Nov 14 05:01:17 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Deletion of /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da_del complete
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:17 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Took 4.11 seconds to deallocate network for instance.
Nov 14 05:01:17 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Deleted allocations for instance ff1ee641-8abc-4e0e-acfe-b48859a428da
Nov 14 05:01:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.objects.instance [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'numa_topology' on Instance uuid ff1ee641-8abc-4e0e-acfe-b48859a428da {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:01:17 user nova-compute[75469]: DEBUG nova.objects.base [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Object Instance<ff1ee641-8abc-4e0e-acfe-b48859a428da> lazy-loaded attributes: resources,numa_topology {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:01:18 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:01:18 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:01:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f6df8e11-68f4-45f1-b083-665f6a745690 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.501s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-6f95b846-afa4-46f3-80d6-b004aeb32683 req-0705e794-746d-4fe7-9d44-3d2763f84b70 service nova] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Received event network-vif-deleted-6f39315a-307d-4436-bdd6-fed7197dfb5e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:19 user nova-compute[75469]: INFO nova.compute.manager [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] [instance: 1c1c2492-d197-4b70-a915-1c594f49f8c1] Took 2.15 seconds to detach 3 volumes for instance.
Nov 14 05:01:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:20 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:01:20 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:01:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:20 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Deleted allocations for instance 1c1c2492-d197-4b70-a915-1c594f49f8c1
Nov 14 05:01:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-61f0e64f-62eb-4dc1-b6f8-c2020a56b8a2 tempest-TaggedBootDevicesTest-1408161910 tempest-TaggedBootDevicesTest-1408161910-project-member] Lock "1c1c2492-d197-4b70-a915-1c594f49f8c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.586s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-e0251018-6d4f-459d-ad96-7c5ec83e2dc9 req-c16c1a61-54b3-496a-a152-63be0dba60d9 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-changed-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-e0251018-6d4f-459d-ad96-7c5ec83e2dc9 req-c16c1a61-54b3-496a-a152-63be0dba60d9 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Refreshing instance network info cache due to event network-changed-2e4570af-365a-415f-b744-e472dedcb2ee. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e0251018-6d4f-459d-ad96-7c5ec83e2dc9 req-c16c1a61-54b3-496a-a152-63be0dba60d9 service nova] Acquiring lock "refresh_cache-6048e25b-b73e-4d63-9ce3-d230dbf76876" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e0251018-6d4f-459d-ad96-7c5ec83e2dc9 req-c16c1a61-54b3-496a-a152-63be0dba60d9 service nova] Acquired lock "refresh_cache-6048e25b-b73e-4d63-9ce3-d230dbf76876" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-e0251018-6d4f-459d-ad96-7c5ec83e2dc9 req-c16c1a61-54b3-496a-a152-63be0dba60d9 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Refreshing network info cache for port 2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lazy-loading 'flavor' on Instance uuid 6048e25b-b73e-4d63-9ce3-d230dbf76876 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:01:27 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Ignoring supplied device name: /dev/vdb
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-e0251018-6d4f-459d-ad96-7c5ec83e2dc9 req-c16c1a61-54b3-496a-a152-63be0dba60d9 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Updated VIF entry in instance network info cache for port 2e4570af-365a-415f-b744-e472dedcb2ee. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-e0251018-6d4f-459d-ad96-7c5ec83e2dc9 req-c16c1a61-54b3-496a-a152-63be0dba60d9 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Updating instance_info_cache with network_info: [{"id": "2e4570af-365a-415f-b744-e472dedcb2ee", "address": "fa:16:3e:09:01:b3", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4570af-36", "ovs_interfaceid": "2e4570af-365a-415f-b744-e472dedcb2ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e0251018-6d4f-459d-ad96-7c5ec83e2dc9 req-c16c1a61-54b3-496a-a152-63be0dba60d9 service nova] Releasing lock "refresh_cache-6048e25b-b73e-4d63-9ce3-d230dbf76876" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:27 user nova-compute[75469]: INFO nova.compute.manager [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Attaching volume 973d022a-5b23-42b3-a829-2c83b87d6984 to /dev/vdb
Nov 14 05:01:27 user nova-compute[75469]: DEBUG os_brick.utils [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a47bdd6-153e-4bcb-b114-27ac7a826b43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1733d5aa-375f-48f8-b8fd-2cbdfacb437d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe372b1-4682-4395-96aa-179d022331eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cab757-794e-49af-873c-21a8728e6408]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:01:27 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:01:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64af61-b270-4d24-aeeb-b56c24459b9f]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG os_brick.utils [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:01:27 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Updating existing volume attachment record: 6bb5de5b-4237-4e8d-8e63-ad75e5758be3 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:01:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRZwVnkU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:01:32 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:01:32 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:01:32 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54bbccd-5adf-4c82-aaf8-718aa65a92df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:01:32 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3671fe36-5068-4196-9000-2b2ea4be0ea3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984] added
Nov 14 05:01:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5306b051-885e-4985-9167-45cf0dadc1ff]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[89318710-c354-4fc9-8475-aab82f6eb9cb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRZwVnkU {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRZwVnkU" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c67b636-bda2-4706-be78-a0304d85d7b0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vRZwVnkU'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca8aead-7ab7-425a-abaa-72dfa6a05622]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b94f891-6f71-4581-978c-f0c68ff15b7e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:32 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:32 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48011f7e-98f7-458c-b5d1-98614f196824]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984, portal: 172.16.0.220,3260]
Nov 14 05:01:32 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984, portal: 172.16.0.220,3260] successful.
Nov 14 05:01:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be129fc-bc1f-47a7-bff3-dd14a18ec0ac]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8214a6ef-b573-4e32-9e04-e38591336c0c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:32 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:32 user nova-compute[75469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 (non-flash)
Nov 14 05:01:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:01:32 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:01:32 user nova-compute[75469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 (non-flash)
Nov 14 05:01:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e59d5b3-4738-4033-b2d5-cd90d3a252dd]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:01:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:01:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRZwVnkU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:01:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:01:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23538653639343562', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:01:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538653639343562', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:01:33 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lazy-loading 'flavor' on Instance uuid 6048e25b-b73e-4d63-9ce3-d230dbf76876 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:01:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:01:33 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:01:33 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:01:33 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:01:33 user nova-compute[75469]:   <serial>973d022a-5b23-42b3-a829-2c83b87d6984</serial>
Nov 14 05:01:33 user nova-compute[75469]: </disk>
Nov 14 05:01:33 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:01:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:01:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:01:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] No VIF found with MAC fa:16:3e:09:01:b3, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:01:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8a30da56-155a-430c-a25e-4c1d163f3446 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.234s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:39 user nova-compute[75469]: INFO nova.compute.manager [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Terminating instance
Nov 14 05:01:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-b8e36da0-080a-4b0f-bb14-2a6d7e2466ab req-7f7c4dd2-8b09-485a-a33c-0390c96b8d0b service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-vif-unplugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b8e36da0-080a-4b0f-bb14-2a6d7e2466ab req-7f7c4dd2-8b09-485a-a33c-0390c96b8d0b service nova] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b8e36da0-080a-4b0f-bb14-2a6d7e2466ab req-7f7c4dd2-8b09-485a-a33c-0390c96b8d0b service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b8e36da0-080a-4b0f-bb14-2a6d7e2466ab req-7f7c4dd2-8b09-485a-a33c-0390c96b8d0b service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-b8e36da0-080a-4b0f-bb14-2a6d7e2466ab req-7f7c4dd2-8b09-485a-a33c-0390c96b8d0b service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] No waiting events found dispatching network-vif-unplugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-b8e36da0-080a-4b0f-bb14-2a6d7e2466ab req-7f7c4dd2-8b09-485a-a33c-0390c96b8d0b service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-vif-unplugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Instance destroyed successfully.
Nov 14 05:01:39 user nova-compute[75469]: DEBUG nova.objects.instance [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'resources' on Instance uuid 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1528269765',display_name='tempest-AttachVolumeNegativeTest-server-1528269765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1528269765',id=15,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdR92RcMJBA2oeZ6PYlLVhSjmZffwdo6450kuRiXxwF4WzTEZmz7GocX+iya5ea5d/2S4Pcoa/7WzGKAjT7mVX0mH/kaTOtYNouOHT4/upg9UZ3Am7CyS/Yv8Wzqk9++Q==',key_name='tempest-keypair-127081686',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-wnw0kfjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=61e6e3ab-dd35-4b49-8f9f-c89cd5db0840,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "address": "fa:16:3e:a3:b1:4e", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae16d917-f1", "ovs_interfaceid": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "address": "fa:16:3e:a3:b1:4e", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae16d917-f1", "ovs_interfaceid": "ae16d917-f1e7-40f3-86cf-ea7150673ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b1:4e,bridge_name='br-int',has_traffic_filtering=True,id=ae16d917-f1e7-40f3-86cf-ea7150673ddb,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae16d917-f1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG os_vif [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b1:4e,bridge_name='br-int',has_traffic_filtering=True,id=ae16d917-f1e7-40f3-86cf-ea7150673ddb,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae16d917-f1') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae16d917-f1, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7273587-8cd4-4225-aba4-dcd6c67293fd) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:39 user nova-compute[75469]: INFO os_vif [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b1:4e,bridge_name='br-int',has_traffic_filtering=True,id=ae16d917-f1e7-40f3-86cf-ea7150673ddb,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae16d917-f1')
Nov 14 05:01:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Deleting instance files /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840_del
Nov 14 05:01:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Deletion of /opt/stack/data/nova/instances/61e6e3ab-dd35-4b49-8f9f-c89cd5db0840_del complete
Nov 14 05:01:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:39 user nova-compute[75469]: INFO nova.compute.manager [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 05:01:39 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:01:39 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:40 user nova-compute[75469]: INFO nova.compute.manager [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Detaching volume 973d022a-5b23-42b3-a829-2c83b87d6984
Nov 14 05:01:40 user nova-compute[75469]: INFO nova.virt.block_device [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Attempting to driver detach volume 973d022a-5b23-42b3-a829-2c83b87d6984 from mountpoint /dev/vdb
Nov 14 05:01:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Attempting to detach device vdb from instance 6048e25b-b73e-4d63-9ce3-d230dbf76876 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:01:40 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:01:40 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:01:40 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:01:40 user nova-compute[75469]:   <serial>973d022a-5b23-42b3-a829-2c83b87d6984</serial>
Nov 14 05:01:40 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:01:40 user nova-compute[75469]: </disk>
Nov 14 05:01:40 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:01:40 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Successfully detached device vdb from instance 6048e25b-b73e-4d63-9ce3-d230dbf76876 from the persistent domain config.
Nov 14 05:01:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6048e25b-b73e-4d63-9ce3-d230dbf76876 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:01:40 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:01:40 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:01:40 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:01:40 user nova-compute[75469]:   <serial>973d022a-5b23-42b3-a829-2c83b87d6984</serial>
Nov 14 05:01:40 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:01:40 user nova-compute[75469]: </disk>
Nov 14 05:01:40 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:40 user nova-compute[75469]: INFO nova.compute.manager [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Terminating instance
Nov 14 05:01:40 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6048e25b-b73e-4d63-9ce3-d230dbf76876 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:40 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Took 0.80 seconds to deallocate network for instance.
Nov 14 05:01:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-81899ed6-54f8-43f1-aeca-e1e419896ea9 req-d65d9b19-96aa-4638-9361-f0335605b637 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-vif-deleted-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:40 user nova-compute[75469]: INFO nova.compute.manager [req-81899ed6-54f8-43f1-aeca-e1e419896ea9 req-d65d9b19-96aa-4638-9361-f0335605b637 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Neutron deleted interface ae16d917-f1e7-40f3-86cf-ea7150673ddb; detaching it from the instance and deleting it from the info cache
Nov 14 05:01:40 user nova-compute[75469]: DEBUG nova.network.neutron [req-81899ed6-54f8-43f1-aeca-e1e419896ea9 req-d65d9b19-96aa-4638-9361-f0335605b637 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-81899ed6-54f8-43f1-aeca-e1e419896ea9 req-d65d9b19-96aa-4638-9361-f0335605b637 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Detach interface failed, port_id=ae16d917-f1e7-40f3-86cf-ea7150673ddb, reason: Instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:41 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Deleted allocations for instance 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0e2c1a48-6dba-4547-aa92-f8c5cedd04f4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.291s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] No waiting events found dispatching network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:41 user nova-compute[75469]: WARNING nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received unexpected event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb for instance with vm_state deleted and task_state None.
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] No waiting events found dispatching network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:41 user nova-compute[75469]: WARNING nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received unexpected event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb for instance with vm_state deleted and task_state None.
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] No waiting events found dispatching network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:41 user nova-compute[75469]: WARNING nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received unexpected event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb for instance with vm_state deleted and task_state None.
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-vif-unplugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] No waiting events found dispatching network-vif-unplugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:41 user nova-compute[75469]: WARNING nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received unexpected event network-vif-unplugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb for instance with vm_state deleted and task_state None.
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Acquiring lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "61e6e3ab-dd35-4b49-8f9f-c89cd5db0840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] No waiting events found dispatching network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:41 user nova-compute[75469]: WARNING nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 61e6e3ab-dd35-4b49-8f9f-c89cd5db0840] Received unexpected event network-vif-plugged-ae16d917-f1e7-40f3-86cf-ea7150673ddb for instance with vm_state deleted and task_state None.
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-unplugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Acquiring lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] No waiting events found dispatching network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:01:41 user nova-compute[75469]: WARNING nova.compute.manager [req-50aab633-e9a3-4f8a-a07c-d4d7fa4edf14 req-7035aa5e-b59d-44c1-8ca4-17f56fdfbc48 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received unexpected event network-vif-plugged-5d0308df-4ec4-495c-b85e-73900b018564 for instance with vm_state active and task_state deleting.
Nov 14 05:01:41 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Instance destroyed successfully.
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.objects.instance [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'resources' on Instance uuid 68c68428-4d79-4dd7-94a1-9c05e5230a8a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1216043162',display_name='tempest-AttachVolumeTestJSON-server-1216043162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1216043162',id=3,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmvdCBIfh48Eeknk9EcyhY/EUByia8dNJsdA49UBgYl79YeoAE1ZBCnXslVyMxP+0apbX7EEDT0C15puJDnVXndeeRGIR/eT6s8JeH6vqhOdqMbAiRlzvoMhvGWyeiHSA==',key_name='tempest-keypair-539876909',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-s5b510vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=68c68428-4d79-4dd7-94a1-9c05e5230a8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "5d0308df-4ec4-495c-b85e-73900b018564", "address": "fa:16:3e:de:a7:a6", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0308df-4e", "ovs_interfaceid": "5d0308df-4ec4-495c-b85e-73900b018564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG os_vif [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d0308df-4e, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60b61529-3cdb-4d58-b1ff-dabb10590a79) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:01:41 user nova-compute[75469]: INFO os_vif [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=5d0308df-4ec4-495c-b85e-73900b018564,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0308df-4e')
Nov 14 05:01:41 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Deleting instance files /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a_del
Nov 14 05:01:41 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Deletion of /opt/stack/data/nova/instances/68c68428-4d79-4dd7-94a1-9c05e5230a8a_del complete
Nov 14 05:01:41 user nova-compute[75469]: INFO nova.compute.manager [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 05:01:41 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:01:41 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:01:42 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:42 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Took 0.82 seconds to deallocate network for instance.
Nov 14 05:01:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:42 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:01:42 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:01:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:42 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Deleted allocations for instance 68c68428-4d79-4dd7-94a1-9c05e5230a8a
Nov 14 05:01:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-86e164e7-0a41-466a-a56f-724b08b9cc92 req-b9f74c46-6290-4ee0-bb33-ca860ab68921 service nova] [instance: 68c68428-4d79-4dd7-94a1-9c05e5230a8a] Received event network-vif-deleted-5d0308df-4ec4-495c-b85e-73900b018564 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a7ee1667-0cb2-4874-914c-5f20079e54bc tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "68c68428-4d79-4dd7-94a1-9c05e5230a8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.140s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:01:49 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:01:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:01:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:01:49 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:01:49 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updating instance_info_cache with network_info: [{"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:01:49 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:01:54 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:01:54 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7980MB free_disk=24.96887969970703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c0ca77d2-8353-4dfc-beed-ac479535b5ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6048e25b-b73e-4d63-9ce3-d230dbf76876 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a48d1c5d-db49-4609-9ca4-21f4578d8943 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:55 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:01:55 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:01:55 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:01:55 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:01:55 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:01:55 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:01:55 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:01:55 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:01:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-f0eba87d-78bd-4464-b497-959590f3771b req-ef8982dd-9492-4306-99ce-26055c91d2a3 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Received event network-changed-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:01:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-f0eba87d-78bd-4464-b497-959590f3771b req-ef8982dd-9492-4306-99ce-26055c91d2a3 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Refreshing instance network info cache due to event network-changed-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:01:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f0eba87d-78bd-4464-b497-959590f3771b req-ef8982dd-9492-4306-99ce-26055c91d2a3 service nova] Acquiring lock "refresh_cache-33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:01:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f0eba87d-78bd-4464-b497-959590f3771b req-ef8982dd-9492-4306-99ce-26055c91d2a3 service nova] Acquired lock "refresh_cache-33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:01:57 user nova-compute[75469]: DEBUG nova.network.neutron [req-f0eba87d-78bd-4464-b497-959590f3771b req-ef8982dd-9492-4306-99ce-26055c91d2a3 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Refreshing network info cache for port 8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:01:58 user nova-compute[75469]: DEBUG nova.network.neutron [req-f0eba87d-78bd-4464-b497-959590f3771b req-ef8982dd-9492-4306-99ce-26055c91d2a3 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Updated VIF entry in instance network info cache for port 8ae34f9c-edaa-41e5-a2f8-2da19cd476fc. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:01:58 user nova-compute[75469]: DEBUG nova.network.neutron [req-f0eba87d-78bd-4464-b497-959590f3771b req-ef8982dd-9492-4306-99ce-26055c91d2a3 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Updating instance_info_cache with network_info: [{"id": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "address": "fa:16:3e:35:aa:fe", "network": {"id": "7d797163-143e-46be-a28c-b80b41197936", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2041146029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad90788eab8447f81cc0d61de06bf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae34f9c-ed", "ovs_interfaceid": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:01:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f0eba87d-78bd-4464-b497-959590f3771b req-ef8982dd-9492-4306-99ce-26055c91d2a3 service nova] Releasing lock "refresh_cache-33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:01:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:58 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lazy-loading 'flavor' on Instance uuid 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:01:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:01:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:01:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:01:58 user nova-compute[75469]: INFO nova.compute.manager [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Attaching volume 7f9066c0-70bf-484b-8812-9bd991e70a92 to /dev/vdb
Nov 14 05:01:59 user nova-compute[75469]: DEBUG os_brick.utils [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce14250-9af4-4f6f-ba19-efade7849a98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0ef140-2c1a-4491-8d3a-58669ca414f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaf3b8c-bf32-4c39-8c66-b258e65d723d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc2e4ec-c269-417a-9ca5-49b5372fc60a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:01:59 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:01:59 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fbfaa4-2a6f-4385-8b21-0fdd5f811374]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG os_brick.utils [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:01:59 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Updating existing volume attachment record: 8f8073ae-900d-4eb7-ab50-f4a4241a5519 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:02:00 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6048e25b-b73e-4d63-9ce3-d230dbf76876 is timed out.
Nov 14 05:02:00 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Successfully detached device vdb from instance 6048e25b-b73e-4d63-9ce3-d230dbf76876 from the live domain config.
Nov 14 05:02:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRZwVnkU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:02:00 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[077a3c9d-efaa-4235-8a36-78824df2edf4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:02:00 user nova-compute[75469]: No targets found.
Nov 14 05:02:00 user nova-compute[75469]: iSNS:
Nov 14 05:02:00 user nova-compute[75469]: No targets found.
Nov 14 05:02:00 user nova-compute[75469]: STATIC:
Nov 14 05:02:00 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984
Nov 14 05:02:00 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:02:00 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:02:00 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8
Nov 14 05:02:00 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:02:00 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:02:00 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:02:00 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:02:00 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:02:00 user nova-compute[75469]: FIRMWARE:
Nov 14 05:02:00 user nova-compute[75469]: No targets found.
Nov 14 05:02:00 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:02:00 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:02:00 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7c6256-e329-486d-bb81-dce4e16575ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb0a4df-ff4d-4ef7-af67-cf88b2e47561]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:00 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:00 user nova-compute[75469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 (non-flash)
Nov 14 05:02:00 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:00 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:00 user nova-compute[75469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 (non-flash)
Nov 14 05:02:00 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7583ef7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26866b5-efd0-40cd-bdd5-53576ef06906]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72d0ca6-29f7-4699-9b06-c4f9674f6109]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aeb4fd-3643-4b99-9a4e-52e79d56ab2a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6337d8f1-e289-4735-b7f7-1a44b53e350c]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[904b0112-8410-4a43-ac50-c44f82407c65]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ea0690-a8f9-4993-a92f-ac11acb2b338]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984, portal: 172.16.0.220,3260]
Nov 14 05:02:01 user nova-compute[75469]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984, portal: 172.16.0.220,3260] successful.
Nov 14 05:02:01 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a3ec0b-f368-4c11-8259-5e45fb39081a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] <== disconnect_volume: return (325ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "e052c963-4a09-4997-9689-94321a3d8af8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "e052c963-4a09-4997-9689-94321a3d8af8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:03 user nova-compute[75469]: DEBUG nova.compute.manager [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lazy-loading 'flavor' on Instance uuid 6048e25b-b73e-4d63-9ce3-d230dbf76876 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:02:04 user nova-compute[75469]: INFO nova.compute.claims [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Claim successful on node user
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2616b4a9-d1ce-41c1-9840-693dab12954e tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.902s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 23.711s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:04 user nova-compute[75469]: INFO nova.compute.manager [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Terminating instance
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-7dbd65e3-037b-402b-8699-6a34a6026ac6 req-1ce8803c-0e21-4d00-b1d9-7da827954513 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-vif-unplugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7dbd65e3-037b-402b-8699-6a34a6026ac6 req-1ce8803c-0e21-4d00-b1d9-7da827954513 service nova] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7dbd65e3-037b-402b-8699-6a34a6026ac6 req-1ce8803c-0e21-4d00-b1d9-7da827954513 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7dbd65e3-037b-402b-8699-6a34a6026ac6 req-1ce8803c-0e21-4d00-b1d9-7da827954513 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-7dbd65e3-037b-402b-8699-6a34a6026ac6 req-1ce8803c-0e21-4d00-b1d9-7da827954513 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] No waiting events found dispatching network-vif-unplugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-7dbd65e3-037b-402b-8699-6a34a6026ac6 req-1ce8803c-0e21-4d00-b1d9-7da827954513 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-vif-unplugged-2e4570af-365a-415f-b744-e472dedcb2ee for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.network.neutron [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:02:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.policy [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95352b2aadd047fc906642a759713a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19aa56a2b2e47648008b954f443ad0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:02:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Creating image(s)
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "/opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "/opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "/opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Instance destroyed successfully.
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lazy-loading 'resources' on Instance uuid 6048e25b-b73e-4d63-9ce3-d230dbf76876 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-170698476',display_name='tempest-VolumesSnapshotTestJSON-instance-170698476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-170698476',id=23,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtzPy+xaTtPfVMjmqnbzHUPYAAtjhCtQdOs30EiYqo8trtCUdy/obra5BdRaYxlqUg/KgE3DPCi5mPNT0sIQ9SqrI6pgLfVHID7a8hpjNFo/BsPSRjqDClDTzVnEyRXqQ==',key_name='tempest-keypair-273112233',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='600ea2b5d6174cd2a3a71944f907e59a',ramdisk_id='',reservation_id='r-9icv325v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-16916651',owner_user_name='tempest-VolumesSnapshotTestJSON-16916651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:59:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30db3f3e090c47d4815bcdc14582ed14',uuid=6048e25b-b73e-4d63-9ce3-d230dbf76876,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e4570af-365a-415f-b744-e472dedcb2ee", "address": "fa:16:3e:09:01:b3", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4570af-36", "ovs_interfaceid": "2e4570af-365a-415f-b744-e472dedcb2ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converting VIF {"id": "2e4570af-365a-415f-b744-e472dedcb2ee", "address": "fa:16:3e:09:01:b3", "network": {"id": "f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-778753659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "600ea2b5d6174cd2a3a71944f907e59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4570af-36", "ovs_interfaceid": "2e4570af-365a-415f-b744-e472dedcb2ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=2e4570af-365a-415f-b744-e472dedcb2ee,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4570af-36') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG os_vif [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=2e4570af-365a-415f-b744-e472dedcb2ee,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4570af-36') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e4570af-36, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02ede5cb-552e-4ac3-bb12-ca6d2235065a) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:02:04 user nova-compute[75469]: INFO os_vif [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=2e4570af-365a-415f-b744-e472dedcb2ee,network=Network(f8552f4d-bf07-48f3-a5bd-67c6e4fafa4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4570af-36')
Nov 14 05:02:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRZwVnkU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:02:05 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c2b512-4c05-4ba3-add4-eb343116ae94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:02:05 user nova-compute[75469]: No targets found.
Nov 14 05:02:05 user nova-compute[75469]: iSNS:
Nov 14 05:02:05 user nova-compute[75469]: No targets found.
Nov 14 05:02:05 user nova-compute[75469]: STATIC:
Nov 14 05:02:05 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8
Nov 14 05:02:05 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:02:05 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:02:05 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:02:05 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:02:05 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:02:05 user nova-compute[75469]: FIRMWARE:
Nov 14 05:02:05 user nova-compute[75469]: No targets found.
Nov 14 05:02:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:02:05 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:02:05 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:973d022a-5b23-42b3-a829-2c83b87d6984', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b06751b-1e97-4354-8b10-8cbf6fa40a08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[02330cd6-aff6-4705-a3f4-d91db95a78de]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c65f1c0>, {}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Disconnecting from: [] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.107s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] <== disconnect_volume: return (109ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:02:05 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Deleting instance files /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876_del
Nov 14 05:02:05 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Deletion of /opt/stack/data/nova/instances/6048e25b-b73e-4d63-9ce3-d230dbf76876_del complete
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.226s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk 1073741824" returned: 0 in 0.057s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Successfully created port: 0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:02:05 user nova-compute[75469]: INFO nova.compute.manager [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.208s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqpYLeiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:02:05 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:02:05 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:02:05 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Cannot resize image /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Ensure instance console log exists: /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a73d330-2f3a-44ca-8fc2-9846120ea600]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:02:05 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d361a3e7-fca9-4513-a86e-d14e2ba43911]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92] added
Nov 14 05:02:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf89f20-a199-450f-984a-9818a629814e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cc6983-0e3e-431d-8271-f8a1e2258296]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqpYLeiV {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqpYLeiV" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4483e38f-67be-4842-9812-1c7cfcae6559]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mqpYLeiV'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac9bc41-a712-4d19-b49e-2bd4cac7f7b2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d32b72-349a-4278-8b81-266692226cbd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4afe2b-a2c0-4ac5-80f3-f6919c325d73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92, portal: 172.16.0.220,3260]
Nov 14 05:02:05 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92, portal: 172.16.0.220,3260] successful.
Nov 14 05:02:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd93c59a-e497-4f7d-a303-744cb8f8dfe2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf7d366-c41c-4469-afc2-ac0172a2aeb5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:02:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:02:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c73b3c-6274-44b9-8ef2-d95aa563d927]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqpYLeiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] No waiting events found dispatching network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:06 user nova-compute[75469]: WARNING nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received unexpected event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee for instance with vm_state active and task_state deleting.
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] No waiting events found dispatching network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:06 user nova-compute[75469]: WARNING nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received unexpected event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee for instance with vm_state active and task_state deleting.
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] No waiting events found dispatching network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:06 user nova-compute[75469]: WARNING nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received unexpected event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee for instance with vm_state active and task_state deleting.
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-vif-unplugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] No waiting events found dispatching network-vif-unplugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-vif-unplugged-2e4570af-365a-415f-b744-e472dedcb2ee for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Acquiring lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] No waiting events found dispatching network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:06 user nova-compute[75469]: WARNING nova.compute.manager [req-19c534cc-b0dd-4f1f-8c53-69afad3b09a6 req-d1658839-e0b4-4a10-b445-ac17ecfe1e63 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received unexpected event network-vif-plugged-2e4570af-365a-415f-b744-e472dedcb2ee for instance with vm_state active and task_state deleting.
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.network.neutron [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Successfully updated port: 0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "refresh_cache-e052c963-4a09-4997-9689-94321a3d8af8" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquired lock "refresh_cache-e052c963-4a09-4997-9689-94321a3d8af8" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.network.neutron [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:02:06 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Took 1.53 seconds to deallocate network for instance.
Nov 14 05:02:06 user nova-compute[75469]: WARNING nova.volume.cinder [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Attachment 6bb5de5b-4237-4e8d-8e63-ad75e5758be3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6bb5de5b-4237-4e8d-8e63-ad75e5758be3. (HTTP 404) (Request-ID: req-59e67e98-a8ba-41a7-9f5a-126f97a6e5fe)
Nov 14 05:02:06 user nova-compute[75469]: INFO nova.compute.manager [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.network.neutron [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-a83f08d9-cf33-4206-a05b-1c698993e0ed req-6f8bf0af-b6c8-41b8-a3a5-02f00df05432 service nova] [instance: 6048e25b-b73e-4d63-9ce3-d230dbf76876] Received event network-vif-deleted-2e4570af-365a-415f-b744-e472dedcb2ee {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26439353137623061', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439353137623061', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lazy-loading 'flavor' on Instance uuid 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:02:07 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:02:07 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:02:07 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:02:07 user nova-compute[75469]:   <serial>7f9066c0-70bf-484b-8812-9bd991e70a92</serial>
Nov 14 05:02:07 user nova-compute[75469]: </disk>
Nov 14 05:02:07 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Updating instance_info_cache with network_info: [{"id": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "address": "fa:16:3e:60:36:7c", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b04ecff-25", "ovs_interfaceid": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Releasing lock "refresh_cache-e052c963-4a09-4997-9689-94321a3d8af8" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Instance network_info: |[{"id": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "address": "fa:16:3e:60:36:7c", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b04ecff-25", "ovs_interfaceid": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Start _get_guest_xml network_info=[{"id": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "address": "fa:16:3e:60:36:7c", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b04ecff-25", "ovs_interfaceid": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:02:07 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:02:07 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:02:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-614520710',display_name='tempest-VolumesActionsTest-instance-614520710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-614520710',id=26,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19aa56a2b2e47648008b954f443ad0d',ramdisk_id='',reservation_id='r-azbgreo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-895657134',owner_user_name='tempest-VolumesActionsTest-895657134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:02:05Z,user_data=None,user_id='95352b2aadd047fc906642a759713a85',uuid=e052c963-4a09-4997-9689-94321a3d8af8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "address": "fa:16:3e:60:36:7c", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b04ecff-25", "ovs_interfaceid": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converting VIF {"id": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "address": "fa:16:3e:60:36:7c", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b04ecff-25", "ovs_interfaceid": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=0b04ecff-25cb-4125-a82b-c245e6dcae27,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b04ecff-25') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.objects.instance [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lazy-loading 'pci_devices' on Instance uuid e052c963-4a09-4997-9689-94321a3d8af8 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:02:07 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Deleted allocations for instance 6048e25b-b73e-4d63-9ce3-d230dbf76876
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:02:07 user nova-compute[75469]:   <uuid>e052c963-4a09-4997-9689-94321a3d8af8</uuid>
Nov 14 05:02:07 user nova-compute[75469]:   <name>instance-0000001a</name>
Nov 14 05:02:07 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:02:07 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:02:07 user nova-compute[75469]:   <metadata>
Nov 14 05:02:07 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:02:07 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:02:07 user nova-compute[75469]:       <nova:name>tempest-VolumesActionsTest-instance-614520710</nova:name>
Nov 14 05:02:07 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:02:07</nova:creationTime>
Nov 14 05:02:07 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:02:07 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:02:07 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:02:07 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:02:07 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:02:07 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:02:07 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:02:07 user nova-compute[75469]:       <nova:owner>
Nov 14 05:02:07 user nova-compute[75469]:         <nova:user uuid="95352b2aadd047fc906642a759713a85">tempest-VolumesActionsTest-895657134-project-member</nova:user>
Nov 14 05:02:07 user nova-compute[75469]:         <nova:project uuid="d19aa56a2b2e47648008b954f443ad0d">tempest-VolumesActionsTest-895657134</nova:project>
Nov 14 05:02:07 user nova-compute[75469]:       </nova:owner>
Nov 14 05:02:07 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:02:07 user nova-compute[75469]:       <nova:ports>
Nov 14 05:02:07 user nova-compute[75469]:         <nova:port uuid="0b04ecff-25cb-4125-a82b-c245e6dcae27">
Nov 14 05:02:07 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 05:02:07 user nova-compute[75469]:         </nova:port>
Nov 14 05:02:07 user nova-compute[75469]:       </nova:ports>
Nov 14 05:02:07 user nova-compute[75469]:     </nova:instance>
Nov 14 05:02:07 user nova-compute[75469]:   </metadata>
Nov 14 05:02:07 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:02:07 user nova-compute[75469]:     <system>
Nov 14 05:02:07 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:02:07 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:02:07 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:02:07 user nova-compute[75469]:       <entry name="serial">e052c963-4a09-4997-9689-94321a3d8af8</entry>
Nov 14 05:02:07 user nova-compute[75469]:       <entry name="uuid">e052c963-4a09-4997-9689-94321a3d8af8</entry>
Nov 14 05:02:07 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:02:07 user nova-compute[75469]:     </system>
Nov 14 05:02:07 user nova-compute[75469]:   </sysinfo>
Nov 14 05:02:07 user nova-compute[75469]:   <os>
Nov 14 05:02:07 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:02:07 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:02:07 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:02:07 user nova-compute[75469]:   </os>
Nov 14 05:02:07 user nova-compute[75469]:   <features>
Nov 14 05:02:07 user nova-compute[75469]:     <acpi/>
Nov 14 05:02:07 user nova-compute[75469]:     <apic/>
Nov 14 05:02:07 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:02:07 user nova-compute[75469]:   </features>
Nov 14 05:02:07 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:02:07 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:02:07 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:02:07 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:02:07 user nova-compute[75469]:   </clock>
Nov 14 05:02:07 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:02:07 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:02:07 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:02:07 user nova-compute[75469]:   </cpu>
Nov 14 05:02:07 user nova-compute[75469]:   <devices>
Nov 14 05:02:07 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:02:07 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:02:07 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk"/>
Nov 14 05:02:07 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:02:07 user nova-compute[75469]:     </disk>
Nov 14 05:02:07 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:02:07 user nova-compute[75469]:       <mac address="fa:16:3e:60:36:7c"/>
Nov 14 05:02:07 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:02:07 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:02:07 user nova-compute[75469]:       <target dev="tap0b04ecff-25"/>
Nov 14 05:02:07 user nova-compute[75469]:     </interface>
Nov 14 05:02:07 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:02:07 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/console.log" append="off"/>
Nov 14 05:02:07 user nova-compute[75469]:     </serial>
Nov 14 05:02:07 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:02:07 user nova-compute[75469]:     <video>
Nov 14 05:02:07 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:02:07 user nova-compute[75469]:     </video>
Nov 14 05:02:07 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:02:07 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:02:07 user nova-compute[75469]:     </rng>
Nov 14 05:02:07 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:02:07 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:02:07 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:02:07 user nova-compute[75469]:     </memballoon>
Nov 14 05:02:07 user nova-compute[75469]:   </devices>
Nov 14 05:02:07 user nova-compute[75469]: </domain>
Nov 14 05:02:07 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-614520710',display_name='tempest-VolumesActionsTest-instance-614520710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-614520710',id=26,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19aa56a2b2e47648008b954f443ad0d',ramdisk_id='',reservation_id='r-azbgreo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-895657134',owner_user_name='tempest-VolumesActionsTest-895657134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:02:05Z,user_data=None,user_id='95352b2aadd047fc906642a759713a85',uuid=e052c963-4a09-4997-9689-94321a3d8af8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "address": "fa:16:3e:60:36:7c", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b04ecff-25", "ovs_interfaceid": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converting VIF {"id": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "address": "fa:16:3e:60:36:7c", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b04ecff-25", "ovs_interfaceid": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=0b04ecff-25cb-4125-a82b-c245e6dcae27,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b04ecff-25') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG os_vif [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=0b04ecff-25cb-4125-a82b-c245e6dcae27,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b04ecff-25') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6219ba5-5321-5ec0-9d4b-912ba579f51b', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b04ecff-25, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b04ecff-25, col_values=(('qos', UUID('ad17ff29-1b58-45aa-95fa-0773ca6e395c')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b04ecff-25, col_values=(('external_ids', {'iface-id': '0b04ecff-25cb-4125-a82b-c245e6dcae27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:36:7c', 'vm-uuid': 'e052c963-4a09-4997-9689-94321a3d8af8'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:07 user nova-compute[75469]: INFO os_vif [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=0b04ecff-25cb-4125-a82b-c245e6dcae27,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b04ecff-25')
Nov 14 05:02:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-20f8a1ba-8f80-461e-ac02-2b2d76f9d626 tempest-VolumesSnapshotTestJSON-16916651 tempest-VolumesSnapshotTestJSON-16916651-project-member] Lock "6048e25b-b73e-4d63-9ce3-d230dbf76876" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.237s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] No VIF found with MAC fa:16:3e:60:36:7c, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] No VIF found with MAC fa:16:3e:35:aa:fe, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:02:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e7cab96d-ad8b-4f76-a21e-f0b395bcb7d9 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.638s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-34861799-78cc-4bda-aa36-626b3fe49e41 req-2cfd19c5-ab11-4542-a6b8-af7027118d15 service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Received event network-vif-plugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-34861799-78cc-4bda-aa36-626b3fe49e41 req-2cfd19c5-ab11-4542-a6b8-af7027118d15 service nova] Acquiring lock "e052c963-4a09-4997-9689-94321a3d8af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-34861799-78cc-4bda-aa36-626b3fe49e41 req-2cfd19c5-ab11-4542-a6b8-af7027118d15 service nova] Lock "e052c963-4a09-4997-9689-94321a3d8af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-34861799-78cc-4bda-aa36-626b3fe49e41 req-2cfd19c5-ab11-4542-a6b8-af7027118d15 service nova] Lock "e052c963-4a09-4997-9689-94321a3d8af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-34861799-78cc-4bda-aa36-626b3fe49e41 req-2cfd19c5-ab11-4542-a6b8-af7027118d15 service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] No waiting events found dispatching network-vif-plugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:08 user nova-compute[75469]: WARNING nova.compute.manager [req-34861799-78cc-4bda-aa36-626b3fe49e41 req-2cfd19c5-ab11-4542-a6b8-af7027118d15 service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Received unexpected event network-vif-plugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 for instance with vm_state building and task_state spawning.
Nov 14 05:02:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-bbc03951-2410-4e5b-ab94-8fc79ba7392f req-89c42156-f7bb-43f0-b47a-a00b2ac07c8e service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Received event network-changed-0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-bbc03951-2410-4e5b-ab94-8fc79ba7392f req-89c42156-f7bb-43f0-b47a-a00b2ac07c8e service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Refreshing instance network info cache due to event network-changed-0b04ecff-25cb-4125-a82b-c245e6dcae27. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bbc03951-2410-4e5b-ab94-8fc79ba7392f req-89c42156-f7bb-43f0-b47a-a00b2ac07c8e service nova] Acquiring lock "refresh_cache-e052c963-4a09-4997-9689-94321a3d8af8" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bbc03951-2410-4e5b-ab94-8fc79ba7392f req-89c42156-f7bb-43f0-b47a-a00b2ac07c8e service nova] Acquired lock "refresh_cache-e052c963-4a09-4997-9689-94321a3d8af8" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:08 user nova-compute[75469]: DEBUG nova.network.neutron [req-bbc03951-2410-4e5b-ab94-8fc79ba7392f req-89c42156-f7bb-43f0-b47a-a00b2ac07c8e service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Refreshing network info cache for port 0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:02:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-bbc03951-2410-4e5b-ab94-8fc79ba7392f req-89c42156-f7bb-43f0-b47a-a00b2ac07c8e service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Updated VIF entry in instance network info cache for port 0b04ecff-25cb-4125-a82b-c245e6dcae27. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:02:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-bbc03951-2410-4e5b-ab94-8fc79ba7392f req-89c42156-f7bb-43f0-b47a-a00b2ac07c8e service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Updating instance_info_cache with network_info: [{"id": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "address": "fa:16:3e:60:36:7c", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b04ecff-25", "ovs_interfaceid": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bbc03951-2410-4e5b-ab94-8fc79ba7392f req-89c42156-f7bb-43f0-b47a-a00b2ac07c8e service nova] Releasing lock "refresh_cache-e052c963-4a09-4997-9689-94321a3d8af8" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.objects.instance [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lazy-loading 'flavor' on Instance uuid 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:10 user nova-compute[75469]: INFO nova.compute.manager [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Attaching volume b88dcb7c-edb3-4257-8628-765bf1b6e592 to /dev/vdc
Nov 14 05:02:10 user nova-compute[75469]: DEBUG os_brick.utils [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[590b57e9-75de-49fc-8835-aa9481183d92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1389894a-0c08-4461-a775-056ec4101612]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f4a0bb-f4a1-4e0f-aedc-dde9ae8dcef4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f308af-0b37-4807-be06-10ae93081a5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:02:10 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c29ec7-1246-4a4a-ac40-afa3e8517277]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG os_brick.utils [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Updating existing volume attachment record: b01a83f2-cf48-4047-9132-b0588ee21142 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.compute.manager [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:02:10 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Instance spawned successfully.
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-d7695c41-3692-411b-94c5-1b15d8f674c7 req-95d8a2df-3466-4241-9774-65e02f27e37d service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Received event network-vif-plugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d7695c41-3692-411b-94c5-1b15d8f674c7 req-95d8a2df-3466-4241-9774-65e02f27e37d service nova] Acquiring lock "e052c963-4a09-4997-9689-94321a3d8af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d7695c41-3692-411b-94c5-1b15d8f674c7 req-95d8a2df-3466-4241-9774-65e02f27e37d service nova] Lock "e052c963-4a09-4997-9689-94321a3d8af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d7695c41-3692-411b-94c5-1b15d8f674c7 req-95d8a2df-3466-4241-9774-65e02f27e37d service nova] Lock "e052c963-4a09-4997-9689-94321a3d8af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-d7695c41-3692-411b-94c5-1b15d8f674c7 req-95d8a2df-3466-4241-9774-65e02f27e37d service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] No waiting events found dispatching network-vif-plugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:10 user nova-compute[75469]: WARNING nova.compute.manager [req-d7695c41-3692-411b-94c5-1b15d8f674c7 req-95d8a2df-3466-4241-9774-65e02f27e37d service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Received unexpected event network-vif-plugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 for instance with vm_state building and task_state spawning.
Nov 14 05:02:11 user nova-compute[75469]: INFO nova.compute.manager [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Took 6.66 seconds to spawn the instance on the hypervisor.
Nov 14 05:02:11 user nova-compute[75469]: DEBUG nova.compute.manager [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:02:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:11 user nova-compute[75469]: INFO nova.compute.manager [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Took 7.45 seconds to build instance.
Nov 14 05:02:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33ab6b6c-ea45-4f95-a0c1-4f3cd9e408c8 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "e052c963-4a09-4997-9689-94321a3d8af8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.548s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:12 user nova-compute[75469]: DEBUG nova.compute.manager [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:02:12 user nova-compute[75469]: INFO nova.compute.manager [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] instance snapshotting
Nov 14 05:02:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Beginning live snapshot process
Nov 14 05:02:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json -f qcow2 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json -f qcow2 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.217s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyr_g2h4p/eb4d61551a1840cb9b4ddf3d6fca9c59.delta 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyr_g2h4p/eb4d61551a1840cb9b4ddf3d6fca9c59.delta 1073741824" returned: 0 in 0.065s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:13 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 05:02:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 05:02:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 05:02:14 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 05:02:14 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 05:02:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyr_g2h4p/eb4d61551a1840cb9b4ddf3d6fca9c59.delta /opt/stack/data/nova/instances/snapshots/tmpyr_g2h4p/eb4d61551a1840cb9b4ddf3d6fca9c59 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEkDAlOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:02:15 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:02:15 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:02:15 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15891ee-fe56-4f79-8f52-29b5a88a4c57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:02:15 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc19dd99-20f3-499f-9806-322c7579dda5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592] added
Nov 14 05:02:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2fa381-4580-4f42-b756-178f0f7a9f69]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyr_g2h4p/eb4d61551a1840cb9b4ddf3d6fca9c59.delta /opt/stack/data/nova/instances/snapshots/tmpyr_g2h4p/eb4d61551a1840cb9b4ddf3d6fca9c59" returned: 0 in 0.623s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Snapshot extracted, beginning image upload
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d023c0e-e404-4376-b877-b94b911e84b7]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEkDAlOt {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEkDAlOt" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbca754-07f4-4120-bc89-0b35a4d73011]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BEkDAlOt'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46fb3ba-7bc0-478d-af55-cd5473fe0ab9]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6e6f14-0ffa-492f-b434-743c49d84940]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[311bc5c7-f0dd-4490-a78e-7f7aed6198f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592, portal: 172.16.0.220,3260]
Nov 14 05:02:15 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592, portal: 172.16.0.220,3260] successful.
Nov 14 05:02:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ad168f-3cc4-438b-a6b7-caa65da1d776]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb052a48-8383-4dde-9091-675befa76003]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 (non-flash)
Nov 14 05:02:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6fc3e2-067e-4f3c-9afc-6599e7dafe44]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:02:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEkDAlOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:02:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:02:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23565653764323633', 'path': '/dev/sdd'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:02:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565653764323633', 'path': '/dev/sdd'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:02:16 user nova-compute[75469]: DEBUG nova.objects.instance [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lazy-loading 'flavor' on Instance uuid 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:02:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:02:16 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:02:16 user nova-compute[75469]:   <source dev="/dev/sdd"/>
Nov 14 05:02:16 user nova-compute[75469]:   <target dev="vdc" bus="virtio"/>
Nov 14 05:02:16 user nova-compute[75469]:   <serial>b88dcb7c-edb3-4257-8628-765bf1b6e592</serial>
Nov 14 05:02:16 user nova-compute[75469]: </disk>
Nov 14 05:02:16 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:02:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:02:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:02:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:02:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] No VIF found with MAC fa:16:3e:35:aa:fe, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:02:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2f3a5870-48a9-4d4f-aa81-99b192c6538a tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.939s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:18 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Snapshot image upload complete
Nov 14 05:02:18 user nova-compute[75469]: INFO nova.compute.manager [None req-44ecf9cf-0343-4723-ab88-7b581f91155a tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Took 5.76 seconds to snapshot the instance on the hypervisor.
Nov 14 05:02:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:18 user nova-compute[75469]: INFO nova.compute.manager [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Detaching volume b88dcb7c-edb3-4257-8628-765bf1b6e592
Nov 14 05:02:18 user nova-compute[75469]: INFO nova.virt.block_device [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Attempting to driver detach volume b88dcb7c-edb3-4257-8628-765bf1b6e592 from mountpoint /dev/vdc
Nov 14 05:02:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Attempting to detach device vdc from instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:02:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:02:18 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:02:18 user nova-compute[75469]:   <source dev="/dev/sdd"/>
Nov 14 05:02:18 user nova-compute[75469]:   <target dev="vdc" bus="virtio"/>
Nov 14 05:02:18 user nova-compute[75469]:   <serial>b88dcb7c-edb3-4257-8628-765bf1b6e592</serial>
Nov 14 05:02:18 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 05:02:18 user nova-compute[75469]: </disk>
Nov 14 05:02:18 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:02:18 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Successfully detached device vdc from instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f from the persistent domain config.
Nov 14 05:02:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:02:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:02:18 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:02:18 user nova-compute[75469]:   <source dev="/dev/sdd"/>
Nov 14 05:02:18 user nova-compute[75469]:   <target dev="vdc" bus="virtio"/>
Nov 14 05:02:18 user nova-compute[75469]:   <serial>b88dcb7c-edb3-4257-8628-765bf1b6e592</serial>
Nov 14 05:02:18 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 05:02:18 user nova-compute[75469]: </disk>
Nov 14 05:02:18 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:02:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:02:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:02:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:02:27 user nova-compute[75469]: INFO nova.compute.claims [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Claim successful on node user
Nov 14 05:02:28 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:02:28 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:02:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG nova.policy [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fedd54c65b8a4adbba761994474cdd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac925f78df5d4746a9bd603db3613839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:02:28 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Creating image(s)
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "/opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "/opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "/opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk 1073741824" returned: 0 in 0.055s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:29 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:02:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:29 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Cannot resize image /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:02:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:02:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Ensure instance console log exists: /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:02:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:29 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Successfully created port: e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Successfully updated port: e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquired lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-67af00ae-aefb-4510-b6e6-8e37d989a8b1 req-83bb946d-5411-4bfa-a848-c23f2b806c80 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received event network-changed-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-67af00ae-aefb-4510-b6e6-8e37d989a8b1 req-83bb946d-5411-4bfa-a848-c23f2b806c80 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Refreshing instance network info cache due to event network-changed-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-67af00ae-aefb-4510-b6e6-8e37d989a8b1 req-83bb946d-5411-4bfa-a848-c23f2b806c80 service nova] Acquiring lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.network.neutron [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updating instance_info_cache with network_info: [{"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Releasing lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Instance network_info: |[{"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-67af00ae-aefb-4510-b6e6-8e37d989a8b1 req-83bb946d-5411-4bfa-a848-c23f2b806c80 service nova] Acquired lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.network.neutron [req-67af00ae-aefb-4510-b6e6-8e37d989a8b1 req-83bb946d-5411-4bfa-a848-c23f2b806c80 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Refreshing network info cache for port e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Start _get_guest_xml network_info=[{"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:02:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:02:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-587132441',display_name='tempest-ServerActionsTestOtherA-server-587132441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-587132441',id=27,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrNma5JBatAznC0LunFsDc00r1VsCTPs0bqBhYBSNLvVRScOCFUVl5vvCUAjsb33gm8T0M5HMwN7cuhFNaAaCpsdN1cxvRi8VbjuP9vzYk0bdC0OKE726Gcl41/vQzpiA==',key_name='tempest-keypair-438915203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-rzzuxydm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:02:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=d742ff9e-3b9f-4d3f-9825-3d3361765b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:77:a5,bridge_name='br-int',has_traffic_filtering=True,id=e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1df6fdf-1b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.objects.instance [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'pci_devices' on Instance uuid d742ff9e-3b9f-4d3f-9825-3d3361765b24 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:02:30 user nova-compute[75469]:   <uuid>d742ff9e-3b9f-4d3f-9825-3d3361765b24</uuid>
Nov 14 05:02:30 user nova-compute[75469]:   <name>instance-0000001b</name>
Nov 14 05:02:30 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:02:30 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:02:30 user nova-compute[75469]:   <metadata>
Nov 14 05:02:30 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:02:30 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:02:30 user nova-compute[75469]:       <nova:name>tempest-ServerActionsTestOtherA-server-587132441</nova:name>
Nov 14 05:02:30 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:02:30</nova:creationTime>
Nov 14 05:02:30 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:02:30 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:02:30 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:02:30 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:02:30 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:02:30 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:02:30 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:02:30 user nova-compute[75469]:       <nova:owner>
Nov 14 05:02:30 user nova-compute[75469]:         <nova:user uuid="fedd54c65b8a4adbba761994474cdd9b">tempest-ServerActionsTestOtherA-2099137527-project-member</nova:user>
Nov 14 05:02:30 user nova-compute[75469]:         <nova:project uuid="ac925f78df5d4746a9bd603db3613839">tempest-ServerActionsTestOtherA-2099137527</nova:project>
Nov 14 05:02:30 user nova-compute[75469]:       </nova:owner>
Nov 14 05:02:30 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:02:30 user nova-compute[75469]:       <nova:ports>
Nov 14 05:02:30 user nova-compute[75469]:         <nova:port uuid="e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1">
Nov 14 05:02:30 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 05:02:30 user nova-compute[75469]:         </nova:port>
Nov 14 05:02:30 user nova-compute[75469]:       </nova:ports>
Nov 14 05:02:30 user nova-compute[75469]:     </nova:instance>
Nov 14 05:02:30 user nova-compute[75469]:   </metadata>
Nov 14 05:02:30 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:02:30 user nova-compute[75469]:     <system>
Nov 14 05:02:30 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:02:30 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:02:30 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:02:30 user nova-compute[75469]:       <entry name="serial">d742ff9e-3b9f-4d3f-9825-3d3361765b24</entry>
Nov 14 05:02:30 user nova-compute[75469]:       <entry name="uuid">d742ff9e-3b9f-4d3f-9825-3d3361765b24</entry>
Nov 14 05:02:30 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:02:30 user nova-compute[75469]:     </system>
Nov 14 05:02:30 user nova-compute[75469]:   </sysinfo>
Nov 14 05:02:30 user nova-compute[75469]:   <os>
Nov 14 05:02:30 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:02:30 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:02:30 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:02:30 user nova-compute[75469]:   </os>
Nov 14 05:02:30 user nova-compute[75469]:   <features>
Nov 14 05:02:30 user nova-compute[75469]:     <acpi/>
Nov 14 05:02:30 user nova-compute[75469]:     <apic/>
Nov 14 05:02:30 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:02:30 user nova-compute[75469]:   </features>
Nov 14 05:02:30 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:02:30 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:02:30 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:02:30 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:02:30 user nova-compute[75469]:   </clock>
Nov 14 05:02:30 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:02:30 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:02:30 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:02:30 user nova-compute[75469]:   </cpu>
Nov 14 05:02:30 user nova-compute[75469]:   <devices>
Nov 14 05:02:30 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:02:30 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:02:30 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk"/>
Nov 14 05:02:30 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:02:30 user nova-compute[75469]:     </disk>
Nov 14 05:02:30 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:02:30 user nova-compute[75469]:       <mac address="fa:16:3e:0b:77:a5"/>
Nov 14 05:02:30 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:02:30 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:02:30 user nova-compute[75469]:       <target dev="tape1df6fdf-1b"/>
Nov 14 05:02:30 user nova-compute[75469]:     </interface>
Nov 14 05:02:30 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:02:30 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/console.log" append="off"/>
Nov 14 05:02:30 user nova-compute[75469]:     </serial>
Nov 14 05:02:30 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:02:30 user nova-compute[75469]:     <video>
Nov 14 05:02:30 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:02:30 user nova-compute[75469]:     </video>
Nov 14 05:02:30 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:02:30 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:02:30 user nova-compute[75469]:     </rng>
Nov 14 05:02:30 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:02:30 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:02:30 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:02:30 user nova-compute[75469]:     </memballoon>
Nov 14 05:02:30 user nova-compute[75469]:   </devices>
Nov 14 05:02:30 user nova-compute[75469]: </domain>
Nov 14 05:02:30 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-587132441',display_name='tempest-ServerActionsTestOtherA-server-587132441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-587132441',id=27,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrNma5JBatAznC0LunFsDc00r1VsCTPs0bqBhYBSNLvVRScOCFUVl5vvCUAjsb33gm8T0M5HMwN7cuhFNaAaCpsdN1cxvRi8VbjuP9vzYk0bdC0OKE726Gcl41/vQzpiA==',key_name='tempest-keypair-438915203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-rzzuxydm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:02:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=d742ff9e-3b9f-4d3f-9825-3d3361765b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:77:a5,bridge_name='br-int',has_traffic_filtering=True,id=e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1df6fdf-1b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG os_vif [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:77:a5,bridge_name='br-int',has_traffic_filtering=True,id=e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1df6fdf-1b') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24b3a237-34f7-5d6c-9464-60b12e9e2975', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1df6fdf-1b, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1df6fdf-1b, col_values=(('qos', UUID('e909fc4e-aa48-4669-b4f1-4c87b6e1133c')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1df6fdf-1b, col_values=(('external_ids', {'iface-id': 'e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:77:a5', 'vm-uuid': 'd742ff9e-3b9f-4d3f-9825-3d3361765b24'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:30 user nova-compute[75469]: INFO os_vif [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:77:a5,bridge_name='br-int',has_traffic_filtering=True,id=e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1df6fdf-1b')
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No VIF found with MAC fa:16:3e:0b:77:a5, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.network.neutron [req-67af00ae-aefb-4510-b6e6-8e37d989a8b1 req-83bb946d-5411-4bfa-a848-c23f2b806c80 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updated VIF entry in instance network info cache for port e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG nova.network.neutron [req-67af00ae-aefb-4510-b6e6-8e37d989a8b1 req-83bb946d-5411-4bfa-a848-c23f2b806c80 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updating instance_info_cache with network_info: [{"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-67af00ae-aefb-4510-b6e6-8e37d989a8b1 req-83bb946d-5411-4bfa-a848-c23f2b806c80 service nova] Releasing lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-1722121a-0d26-4680-b5cc-d665c1c3d8c7 req-6e1cf8aa-1a18-459d-a47a-b42215c0de07 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received event network-vif-plugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1722121a-0d26-4680-b5cc-d665c1c3d8c7 req-6e1cf8aa-1a18-459d-a47a-b42215c0de07 service nova] Acquiring lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1722121a-0d26-4680-b5cc-d665c1c3d8c7 req-6e1cf8aa-1a18-459d-a47a-b42215c0de07 service nova] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1722121a-0d26-4680-b5cc-d665c1c3d8c7 req-6e1cf8aa-1a18-459d-a47a-b42215c0de07 service nova] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-1722121a-0d26-4680-b5cc-d665c1c3d8c7 req-6e1cf8aa-1a18-459d-a47a-b42215c0de07 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] No waiting events found dispatching network-vif-plugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:32 user nova-compute[75469]: WARNING nova.compute.manager [req-1722121a-0d26-4680-b5cc-d665c1c3d8c7 req-6e1cf8aa-1a18-459d-a47a-b42215c0de07 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received unexpected event network-vif-plugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 for instance with vm_state building and task_state spawning.
Nov 14 05:02:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:02:32 user nova-compute[75469]: INFO nova.compute.claims [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Claim successful on node user
Nov 14 05:02:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:02:32 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:02:33 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:02:33 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG nova.policy [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e98acc8e0c8044cca5d6f7a35b3bdad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59f6cc7c2254d4ba2581a445e02075f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:02:33 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Creating image(s)
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "/opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "/opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.200s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk 1073741824" returned: 0 in 0.057s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.220s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:02:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Cannot resize image /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Ensure instance console log exists: /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Successfully created port: b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-7737b64f-0531-4cf1-a5c5-993f8699e100 req-01558566-ee84-48f2-8a9a-a61ebdc1fe95 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received event network-vif-plugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7737b64f-0531-4cf1-a5c5-993f8699e100 req-01558566-ee84-48f2-8a9a-a61ebdc1fe95 service nova] Acquiring lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7737b64f-0531-4cf1-a5c5-993f8699e100 req-01558566-ee84-48f2-8a9a-a61ebdc1fe95 service nova] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7737b64f-0531-4cf1-a5c5-993f8699e100 req-01558566-ee84-48f2-8a9a-a61ebdc1fe95 service nova] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-7737b64f-0531-4cf1-a5c5-993f8699e100 req-01558566-ee84-48f2-8a9a-a61ebdc1fe95 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] No waiting events found dispatching network-vif-plugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:34 user nova-compute[75469]: WARNING nova.compute.manager [req-7737b64f-0531-4cf1-a5c5-993f8699e100 req-01558566-ee84-48f2-8a9a-a61ebdc1fe95 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received unexpected event network-vif-plugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 for instance with vm_state building and task_state spawning.
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:02:34 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Instance spawned successfully.
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:34 user nova-compute[75469]: INFO nova.compute.manager [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:02:34 user nova-compute[75469]: INFO nova.compute.manager [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Took 6.97 seconds to build instance.
Nov 14 05:02:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9497624e-7991-4239-98d2-9e7c97ddb81e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.075s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Successfully updated port: b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "refresh_cache-4d0f0f5d-0fd7-4ef1-8431-e010764112ee" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquired lock "refresh_cache-4d0f0f5d-0fd7-4ef1-8431-e010764112ee" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-08b3c17e-1264-4d59-813d-093a10e70a95 req-aef062de-6214-4351-b545-de3eedce4098 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Received event network-changed-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-08b3c17e-1264-4d59-813d-093a10e70a95 req-aef062de-6214-4351-b545-de3eedce4098 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Refreshing instance network info cache due to event network-changed-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:02:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-08b3c17e-1264-4d59-813d-093a10e70a95 req-aef062de-6214-4351-b545-de3eedce4098 service nova] Acquiring lock "refresh_cache-4d0f0f5d-0fd7-4ef1-8431-e010764112ee" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Updating instance_info_cache with network_info: [{"id": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "address": "fa:16:3e:f9:f5:91", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09ee5b7-60", "ovs_interfaceid": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Releasing lock "refresh_cache-4d0f0f5d-0fd7-4ef1-8431-e010764112ee" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Instance network_info: |[{"id": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "address": "fa:16:3e:f9:f5:91", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09ee5b7-60", "ovs_interfaceid": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-08b3c17e-1264-4d59-813d-093a10e70a95 req-aef062de-6214-4351-b545-de3eedce4098 service nova] Acquired lock "refresh_cache-4d0f0f5d-0fd7-4ef1-8431-e010764112ee" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.network.neutron [req-08b3c17e-1264-4d59-813d-093a10e70a95 req-aef062de-6214-4351-b545-de3eedce4098 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Refreshing network info cache for port b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Start _get_guest_xml network_info=[{"id": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "address": "fa:16:3e:f9:f5:91", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09ee5b7-60", "ovs_interfaceid": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:02:35 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:02:35 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-618939133',display_name='tempest-AttachVolumeNegativeTest-server-618939133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-618939133',id=28,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgD5EbpgDAWYxon+ZVbyzskI+1DqQzKqlUf2wCnnMyidpkooJi76RJkYS3xVSXueU+Y55jYlJkUeIdzhaSKdUWVB8g44Y6bAbwXEZjGWPE8HkPaTC93dEoJa9uI7dJ75w==',key_name='tempest-keypair-2049472258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-hxq6hnxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=4d0f0f5d-0fd7-4ef1-8431-e010764112ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "address": "fa:16:3e:f9:f5:91", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09ee5b7-60", "ovs_interfaceid": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "address": "fa:16:3e:f9:f5:91", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09ee5b7-60", "ovs_interfaceid": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=b09ee5b7-60ed-43d1-8a22-55f4e1dedf59,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09ee5b7-60') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.objects.instance [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d0f0f5d-0fd7-4ef1-8431-e010764112ee {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:02:35 user nova-compute[75469]:   <uuid>4d0f0f5d-0fd7-4ef1-8431-e010764112ee</uuid>
Nov 14 05:02:35 user nova-compute[75469]:   <name>instance-0000001c</name>
Nov 14 05:02:35 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:02:35 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:02:35 user nova-compute[75469]:   <metadata>
Nov 14 05:02:35 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:02:35 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:02:35 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeNegativeTest-server-618939133</nova:name>
Nov 14 05:02:35 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:02:35</nova:creationTime>
Nov 14 05:02:35 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:02:35 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:02:35 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:02:35 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:02:35 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:02:35 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:02:35 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:02:35 user nova-compute[75469]:       <nova:owner>
Nov 14 05:02:35 user nova-compute[75469]:         <nova:user uuid="e98acc8e0c8044cca5d6f7a35b3bdad0">tempest-AttachVolumeNegativeTest-1768463318-project-member</nova:user>
Nov 14 05:02:35 user nova-compute[75469]:         <nova:project uuid="c59f6cc7c2254d4ba2581a445e02075f">tempest-AttachVolumeNegativeTest-1768463318</nova:project>
Nov 14 05:02:35 user nova-compute[75469]:       </nova:owner>
Nov 14 05:02:35 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:02:35 user nova-compute[75469]:       <nova:ports>
Nov 14 05:02:35 user nova-compute[75469]:         <nova:port uuid="b09ee5b7-60ed-43d1-8a22-55f4e1dedf59">
Nov 14 05:02:35 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 05:02:35 user nova-compute[75469]:         </nova:port>
Nov 14 05:02:35 user nova-compute[75469]:       </nova:ports>
Nov 14 05:02:35 user nova-compute[75469]:     </nova:instance>
Nov 14 05:02:35 user nova-compute[75469]:   </metadata>
Nov 14 05:02:35 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:02:35 user nova-compute[75469]:     <system>
Nov 14 05:02:35 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:02:35 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:02:35 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:02:35 user nova-compute[75469]:       <entry name="serial">4d0f0f5d-0fd7-4ef1-8431-e010764112ee</entry>
Nov 14 05:02:35 user nova-compute[75469]:       <entry name="uuid">4d0f0f5d-0fd7-4ef1-8431-e010764112ee</entry>
Nov 14 05:02:35 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:02:35 user nova-compute[75469]:     </system>
Nov 14 05:02:35 user nova-compute[75469]:   </sysinfo>
Nov 14 05:02:35 user nova-compute[75469]:   <os>
Nov 14 05:02:35 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:02:35 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:02:35 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:02:35 user nova-compute[75469]:   </os>
Nov 14 05:02:35 user nova-compute[75469]:   <features>
Nov 14 05:02:35 user nova-compute[75469]:     <acpi/>
Nov 14 05:02:35 user nova-compute[75469]:     <apic/>
Nov 14 05:02:35 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:02:35 user nova-compute[75469]:   </features>
Nov 14 05:02:35 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:02:35 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:02:35 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:02:35 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:02:35 user nova-compute[75469]:   </clock>
Nov 14 05:02:35 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:02:35 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:02:35 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:02:35 user nova-compute[75469]:   </cpu>
Nov 14 05:02:35 user nova-compute[75469]:   <devices>
Nov 14 05:02:35 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:02:35 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:02:35 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk"/>
Nov 14 05:02:35 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:02:35 user nova-compute[75469]:     </disk>
Nov 14 05:02:35 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:02:35 user nova-compute[75469]:       <mac address="fa:16:3e:f9:f5:91"/>
Nov 14 05:02:35 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:02:35 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:02:35 user nova-compute[75469]:       <target dev="tapb09ee5b7-60"/>
Nov 14 05:02:35 user nova-compute[75469]:     </interface>
Nov 14 05:02:35 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:02:35 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/console.log" append="off"/>
Nov 14 05:02:35 user nova-compute[75469]:     </serial>
Nov 14 05:02:35 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:02:35 user nova-compute[75469]:     <video>
Nov 14 05:02:35 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:02:35 user nova-compute[75469]:     </video>
Nov 14 05:02:35 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:02:35 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:02:35 user nova-compute[75469]:     </rng>
Nov 14 05:02:35 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:02:35 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:02:35 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:02:35 user nova-compute[75469]:     </memballoon>
Nov 14 05:02:35 user nova-compute[75469]:   </devices>
Nov 14 05:02:35 user nova-compute[75469]: </domain>
Nov 14 05:02:35 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-618939133',display_name='tempest-AttachVolumeNegativeTest-server-618939133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-618939133',id=28,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgD5EbpgDAWYxon+ZVbyzskI+1DqQzKqlUf2wCnnMyidpkooJi76RJkYS3xVSXueU+Y55jYlJkUeIdzhaSKdUWVB8g44Y6bAbwXEZjGWPE8HkPaTC93dEoJa9uI7dJ75w==',key_name='tempest-keypair-2049472258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-hxq6hnxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=4d0f0f5d-0fd7-4ef1-8431-e010764112ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "address": "fa:16:3e:f9:f5:91", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09ee5b7-60", "ovs_interfaceid": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "address": "fa:16:3e:f9:f5:91", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09ee5b7-60", "ovs_interfaceid": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=b09ee5b7-60ed-43d1-8a22-55f4e1dedf59,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09ee5b7-60') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG os_vif [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=b09ee5b7-60ed-43d1-8a22-55f4e1dedf59,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09ee5b7-60') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5221f449-d1c4-5bf2-9e59-0fe026ed8f60', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb09ee5b7-60, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb09ee5b7-60, col_values=(('qos', UUID('dd03f0b1-1a68-444c-8bb6-4a3bd1dd12bc')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb09ee5b7-60, col_values=(('external_ids', {'iface-id': 'b09ee5b7-60ed-43d1-8a22-55f4e1dedf59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:f5:91', 'vm-uuid': '4d0f0f5d-0fd7-4ef1-8431-e010764112ee'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:35 user nova-compute[75469]: INFO os_vif [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=b09ee5b7-60ed-43d1-8a22-55f4e1dedf59,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09ee5b7-60')
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No VIF found with MAC fa:16:3e:f9:f5:91, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.compute.manager [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.network.neutron [req-08b3c17e-1264-4d59-813d-093a10e70a95 req-aef062de-6214-4351-b545-de3eedce4098 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Updated VIF entry in instance network info cache for port b09ee5b7-60ed-43d1-8a22-55f4e1dedf59. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.network.neutron [req-08b3c17e-1264-4d59-813d-093a10e70a95 req-aef062de-6214-4351-b545-de3eedce4098 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Updating instance_info_cache with network_info: [{"id": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "address": "fa:16:3e:f9:f5:91", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09ee5b7-60", "ovs_interfaceid": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-08b3c17e-1264-4d59-813d-093a10e70a95 req-aef062de-6214-4351-b545-de3eedce4098 service nova] Releasing lock "refresh_cache-4d0f0f5d-0fd7-4ef1-8431-e010764112ee" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:35 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:02:35 user nova-compute[75469]: INFO nova.compute.claims [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Claim successful on node user
Nov 14 05:02:36 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG nova.network.neutron [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:02:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:02:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG nova.policy [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3142f0a24ee841878d06e14817fa1f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e85721ebed4cccaecde59d1944cd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:02:36 user nova-compute[75469]: INFO nova.compute.manager [None req-7270e257-a76e-4866-a637-cfca11fe36da tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Unrescuing
Nov 14 05:02:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7270e257-a76e-4866-a637-cfca11fe36da tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7270e257-a76e-4866-a637-cfca11fe36da tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquired lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG nova.network.neutron [None req-7270e257-a76e-4866-a637-cfca11fe36da tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:02:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Creating image(s)
Nov 14 05:02:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "/opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "/opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.232s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.203s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk 1073741824" returned: 0 in 0.079s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.201s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-e0bb68d1-55a7-4f5e-ad68-715110ec50a2 req-c269cee5-085e-48cf-8297-2acc42926734 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Received event network-vif-plugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e0bb68d1-55a7-4f5e-ad68-715110ec50a2 req-c269cee5-085e-48cf-8297-2acc42926734 service nova] Acquiring lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e0bb68d1-55a7-4f5e-ad68-715110ec50a2 req-c269cee5-085e-48cf-8297-2acc42926734 service nova] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e0bb68d1-55a7-4f5e-ad68-715110ec50a2 req-c269cee5-085e-48cf-8297-2acc42926734 service nova] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-e0bb68d1-55a7-4f5e-ad68-715110ec50a2 req-c269cee5-085e-48cf-8297-2acc42926734 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] No waiting events found dispatching network-vif-plugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:37 user nova-compute[75469]: WARNING nova.compute.manager [req-e0bb68d1-55a7-4f5e-ad68-715110ec50a2 req-c269cee5-085e-48cf-8297-2acc42926734 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Received unexpected event network-vif-plugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 for instance with vm_state building and task_state spawning.
Nov 14 05:02:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG nova.network.neutron [None req-7270e257-a76e-4866-a637-cfca11fe36da tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updating instance_info_cache with network_info: [{"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7270e257-a76e-4866-a637-cfca11fe36da tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Releasing lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG nova.objects.instance [None req-7270e257-a76e-4866-a637-cfca11fe36da tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'flavor' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Cannot resize image /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Ensure instance console log exists: /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-7f302635-ff8f-4601-9427-c3acf506932a req-a3c66203-f34e-49f5-9f9e-2020f4adff20 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-unplugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7f302635-ff8f-4601-9427-c3acf506932a req-a3c66203-f34e-49f5-9f9e-2020f4adff20 service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7f302635-ff8f-4601-9427-c3acf506932a req-a3c66203-f34e-49f5-9f9e-2020f4adff20 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7f302635-ff8f-4601-9427-c3acf506932a req-a3c66203-f34e-49f5-9f9e-2020f4adff20 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-7f302635-ff8f-4601-9427-c3acf506932a req-a3c66203-f34e-49f5-9f9e-2020f4adff20 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-unplugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:38 user nova-compute[75469]: WARNING nova.compute.manager [req-7f302635-ff8f-4601-9427-c3acf506932a req-a3c66203-f34e-49f5-9f9e-2020f4adff20 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received unexpected event network-vif-unplugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:02:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Successfully created port: 472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:02:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:38 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Instance destroyed successfully.
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.network.neutron [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Successfully updated port: 472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "refresh_cache-a8350c59-92c2-4348-bea4-482079ec0f5a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquired lock "refresh_cache-a8350c59-92c2-4348-bea4-482079ec0f5a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.network.neutron [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-50031f0d-9712-494d-96cd-7db336c33813 req-983ab6e4-deee-47bb-8465-417fda3ff7eb service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Received event network-changed-472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-50031f0d-9712-494d-96cd-7db336c33813 req-983ab6e4-deee-47bb-8465-417fda3ff7eb service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Refreshing instance network info cache due to event network-changed-472a1743-c919-4b69-aa32-7cebc40c439e. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50031f0d-9712-494d-96cd-7db336c33813 req-983ab6e4-deee-47bb-8465-417fda3ff7eb service nova] Acquiring lock "refresh_cache-a8350c59-92c2-4348-bea4-482079ec0f5a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.network.neutron [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:02:39 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f is timed out.
Nov 14 05:02:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Successfully detached device vdc from instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f from the live domain config.
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEkDAlOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:02:39 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae14f7ea-5fa1-49f9-9f26-3fa814936a8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:02:39 user nova-compute[75469]: No targets found.
Nov 14 05:02:39 user nova-compute[75469]: iSNS:
Nov 14 05:02:39 user nova-compute[75469]: No targets found.
Nov 14 05:02:39 user nova-compute[75469]: STATIC:
Nov 14 05:02:39 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592
Nov 14 05:02:39 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:02:39 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:02:39 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8
Nov 14 05:02:39 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:02:39 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:02:39 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92
Nov 14 05:02:39 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:02:39 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:02:39 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:02:39 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:02:39 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:02:39 user nova-compute[75469]: FIRMWARE:
Nov 14 05:02:39 user nova-compute[75469]: No targets found.
Nov 14 05:02:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:02:39 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:02:39 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7003f27f-c8ed-4092-89ac-cd81d71afe36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f08c746-a5f5-451f-b300-317f6b45353c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:39 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:39 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:02:39 user nova-compute[75469]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 (non-flash)
Nov 14 05:02:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:02:39 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:02:39 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:02:39 user nova-compute[75469]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 (non-flash)
Nov 14 05:02:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c726b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592'): ({'sdd'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Removing single pathed devices sdd {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[455c5553-09b5-4b1c-86af-447092b0df17]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd12a692-33b4-4b50-ac38-75eb5a38314b]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Flushing IO for device /dev/sdd {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffb888b-0f66-4d5b-9bb7-a6208a7d7f7c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.network.neutron [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Updating instance_info_cache with network_info: [{"id": "472a1743-c919-4b69-aa32-7cebc40c439e", "address": "fa:16:3e:b4:92:5f", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472a1743-c9", "ovs_interfaceid": "472a1743-c919-4b69-aa32-7cebc40c439e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7eeb63-d9c5-4e27-be32-3fa762058ead]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Releasing lock "refresh_cache-a8350c59-92c2-4348-bea4-482079ec0f5a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Instance network_info: |[{"id": "472a1743-c919-4b69-aa32-7cebc40c439e", "address": "fa:16:3e:b4:92:5f", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472a1743-c9", "ovs_interfaceid": "472a1743-c919-4b69-aa32-7cebc40c439e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50031f0d-9712-494d-96cd-7db336c33813 req-983ab6e4-deee-47bb-8465-417fda3ff7eb service nova] Acquired lock "refresh_cache-a8350c59-92c2-4348-bea4-482079ec0f5a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.network.neutron [req-50031f0d-9712-494d-96cd-7db336c33813 req-983ab6e4-deee-47bb-8465-417fda3ff7eb service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Refreshing network info cache for port 472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Start _get_guest_xml network_info=[{"id": "472a1743-c919-4b69-aa32-7cebc40c439e", "address": "fa:16:3e:b4:92:5f", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472a1743-c9", "ovs_interfaceid": "472a1743-c919-4b69-aa32-7cebc40c439e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:02:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Instance spawned successfully.
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9dbb7f-89d6-406c-a5e8-075611746d8a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:39 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:02:39 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047052642',display_name='tempest-AttachVolumeTestJSON-server-2047052642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047052642',id=29,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4LWOIU63vNi3HIGchdoFmGy72dIFXiEFAZdK8fh4yC3Y82tI2drCcxTacLVm1WX0f80bxjwyfJQ1Y78YwNTyK6PUAPorRO+vs3G3brS7kYqLxJqIdi3Gm61H9S/zO2Zg==',key_name='tempest-keypair-1109306906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-g8s038zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:02:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=a8350c59-92c2-4348-bea4-482079ec0f5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "472a1743-c919-4b69-aa32-7cebc40c439e", "address": "fa:16:3e:b4:92:5f", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472a1743-c9", "ovs_interfaceid": "472a1743-c919-4b69-aa32-7cebc40c439e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "472a1743-c919-4b69-aa32-7cebc40c439e", "address": "fa:16:3e:b4:92:5f", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472a1743-c9", "ovs_interfaceid": "472a1743-c919-4b69-aa32-7cebc40c439e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:92:5f,bridge_name='br-int',has_traffic_filtering=True,id=472a1743-c919-4b69-aa32-7cebc40c439e,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472a1743-c9') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.objects.instance [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'pci_devices' on Instance uuid a8350c59-92c2-4348-bea4-482079ec0f5a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cb53f3-7139-4e2b-929a-bda5d735b8c0]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592, portal: 172.16.0.220,3260]
Nov 14 05:02:39 user nova-compute[75469]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592, portal: 172.16.0.220,3260] successful.
Nov 14 05:02:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:02:39 user nova-compute[75469]:   <uuid>a8350c59-92c2-4348-bea4-482079ec0f5a</uuid>
Nov 14 05:02:39 user nova-compute[75469]:   <name>instance-0000001d</name>
Nov 14 05:02:39 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:02:39 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:02:39 user nova-compute[75469]:   <metadata>
Nov 14 05:02:39 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:02:39 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:02:39 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeTestJSON-server-2047052642</nova:name>
Nov 14 05:02:39 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:02:39</nova:creationTime>
Nov 14 05:02:39 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:02:39 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:02:39 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:02:39 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:02:39 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:02:39 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:02:39 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:02:39 user nova-compute[75469]:       <nova:owner>
Nov 14 05:02:39 user nova-compute[75469]:         <nova:user uuid="3142f0a24ee841878d06e14817fa1f86">tempest-AttachVolumeTestJSON-2079958443-project-member</nova:user>
Nov 14 05:02:39 user nova-compute[75469]:         <nova:project uuid="f7e85721ebed4cccaecde59d1944cd64">tempest-AttachVolumeTestJSON-2079958443</nova:project>
Nov 14 05:02:39 user nova-compute[75469]:       </nova:owner>
Nov 14 05:02:39 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:02:39 user nova-compute[75469]:       <nova:ports>
Nov 14 05:02:39 user nova-compute[75469]:         <nova:port uuid="472a1743-c919-4b69-aa32-7cebc40c439e">
Nov 14 05:02:39 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 05:02:39 user nova-compute[75469]:         </nova:port>
Nov 14 05:02:39 user nova-compute[75469]:       </nova:ports>
Nov 14 05:02:39 user nova-compute[75469]:     </nova:instance>
Nov 14 05:02:39 user nova-compute[75469]:   </metadata>
Nov 14 05:02:39 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:02:39 user nova-compute[75469]:     <system>
Nov 14 05:02:39 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:02:39 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:02:39 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:02:39 user nova-compute[75469]:       <entry name="serial">a8350c59-92c2-4348-bea4-482079ec0f5a</entry>
Nov 14 05:02:39 user nova-compute[75469]:       <entry name="uuid">a8350c59-92c2-4348-bea4-482079ec0f5a</entry>
Nov 14 05:02:39 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:02:39 user nova-compute[75469]:     </system>
Nov 14 05:02:39 user nova-compute[75469]:   </sysinfo>
Nov 14 05:02:39 user nova-compute[75469]:   <os>
Nov 14 05:02:39 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:02:39 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:02:39 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:02:39 user nova-compute[75469]:   </os>
Nov 14 05:02:39 user nova-compute[75469]:   <features>
Nov 14 05:02:39 user nova-compute[75469]:     <acpi/>
Nov 14 05:02:39 user nova-compute[75469]:     <apic/>
Nov 14 05:02:39 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:02:39 user nova-compute[75469]:   </features>
Nov 14 05:02:39 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:02:39 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:02:39 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:02:39 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:02:39 user nova-compute[75469]:   </clock>
Nov 14 05:02:39 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:02:39 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:02:39 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:02:39 user nova-compute[75469]:   </cpu>
Nov 14 05:02:39 user nova-compute[75469]:   <devices>
Nov 14 05:02:39 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:02:39 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:02:39 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk"/>
Nov 14 05:02:39 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:02:39 user nova-compute[75469]:     </disk>
Nov 14 05:02:39 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:02:39 user nova-compute[75469]:       <mac address="fa:16:3e:b4:92:5f"/>
Nov 14 05:02:39 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:02:39 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:02:39 user nova-compute[75469]:       <target dev="tap472a1743-c9"/>
Nov 14 05:02:39 user nova-compute[75469]:     </interface>
Nov 14 05:02:39 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:02:39 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/console.log" append="off"/>
Nov 14 05:02:39 user nova-compute[75469]:     </serial>
Nov 14 05:02:39 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:02:39 user nova-compute[75469]:     <video>
Nov 14 05:02:39 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:02:39 user nova-compute[75469]:     </video>
Nov 14 05:02:39 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:02:39 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:02:39 user nova-compute[75469]:     </rng>
Nov 14 05:02:39 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:02:39 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:02:39 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:02:39 user nova-compute[75469]:     </memballoon>
Nov 14 05:02:39 user nova-compute[75469]:   </devices>
Nov 14 05:02:39 user nova-compute[75469]: </domain>
Nov 14 05:02:39 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047052642',display_name='tempest-AttachVolumeTestJSON-server-2047052642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047052642',id=29,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4LWOIU63vNi3HIGchdoFmGy72dIFXiEFAZdK8fh4yC3Y82tI2drCcxTacLVm1WX0f80bxjwyfJQ1Y78YwNTyK6PUAPorRO+vs3G3brS7kYqLxJqIdi3Gm61H9S/zO2Zg==',key_name='tempest-keypair-1109306906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-g8s038zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:02:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=a8350c59-92c2-4348-bea4-482079ec0f5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "472a1743-c919-4b69-aa32-7cebc40c439e", "address": "fa:16:3e:b4:92:5f", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472a1743-c9", "ovs_interfaceid": "472a1743-c919-4b69-aa32-7cebc40c439e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "472a1743-c919-4b69-aa32-7cebc40c439e", "address": "fa:16:3e:b4:92:5f", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472a1743-c9", "ovs_interfaceid": "472a1743-c919-4b69-aa32-7cebc40c439e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:92:5f,bridge_name='br-int',has_traffic_filtering=True,id=472a1743-c919-4b69-aa32-7cebc40c439e,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472a1743-c9') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_vif [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:92:5f,bridge_name='br-int',has_traffic_filtering=True,id=472a1743-c919-4b69-aa32-7cebc40c439e,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472a1743-c9') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b23458a7-3ad4-5574-a3c2-0f9d328db2dd', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88dcb7c-edb3-4257-8628-765bf1b6e592 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc33303-cf3f-459d-b008-a8dfb94a44aa]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] <== disconnect_volume: return (433ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap472a1743-c9, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap472a1743-c9, col_values=(('qos', UUID('b9f96793-76db-41bf-b7af-16052ed30f7a')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap472a1743-c9, col_values=(('external_ids', {'iface-id': '472a1743-c919-4b69-aa32-7cebc40c439e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:92:5f', 'vm-uuid': 'a8350c59-92c2-4348-bea4-482079ec0f5a'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: INFO nova.compute.manager [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:39 user nova-compute[75469]: INFO os_vif [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:92:5f,bridge_name='br-int',has_traffic_filtering=True,id=472a1743-c919-4b69-aa32-7cebc40c439e,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472a1743-c9')
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No VIF found with MAC fa:16:3e:b4:92:5f, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Received event network-vif-plugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] Acquiring lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] No waiting events found dispatching network-vif-plugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:39 user nova-compute[75469]: WARNING nova.compute.manager [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Received unexpected event network-vif-plugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 for instance with vm_state building and task_state spawning.
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-changed-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Refreshing instance network info cache due to event network-changed-bf280bdb-b07e-4472-b87a-304b48127d7c. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] Acquiring lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] Acquired lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:39 user nova-compute[75469]: DEBUG nova.network.neutron [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Refreshing network info cache for port bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:02:39 user nova-compute[75469]: INFO nova.compute.manager [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Took 7.22 seconds to build instance.
Nov 14 05:02:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a9ce598d-50ee-47ba-b037-1611800760cf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.392s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-9411ccb7-6306-43ef-b62b-47c7a41fff10 req-e0e13a56-684b-4d62-803f-fc905f741eb8 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9411ccb7-6306-43ef-b62b-47c7a41fff10 req-e0e13a56-684b-4d62-803f-fc905f741eb8 service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9411ccb7-6306-43ef-b62b-47c7a41fff10 req-e0e13a56-684b-4d62-803f-fc905f741eb8 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9411ccb7-6306-43ef-b62b-47c7a41fff10 req-e0e13a56-684b-4d62-803f-fc905f741eb8 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-9411ccb7-6306-43ef-b62b-47c7a41fff10 req-e0e13a56-684b-4d62-803f-fc905f741eb8 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:40 user nova-compute[75469]: WARNING nova.compute.manager [req-9411ccb7-6306-43ef-b62b-47c7a41fff10 req-e0e13a56-684b-4d62-803f-fc905f741eb8 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received unexpected event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:02:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG nova.objects.instance [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lazy-loading 'flavor' on Instance uuid 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-29e2412d-c132-4df1-bec8-aa82d6e65830 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.943s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG nova.network.neutron [req-50031f0d-9712-494d-96cd-7db336c33813 req-983ab6e4-deee-47bb-8465-417fda3ff7eb service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Updated VIF entry in instance network info cache for port 472a1743-c919-4b69-aa32-7cebc40c439e. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG nova.network.neutron [req-50031f0d-9712-494d-96cd-7db336c33813 req-983ab6e4-deee-47bb-8465-417fda3ff7eb service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Updating instance_info_cache with network_info: [{"id": "472a1743-c919-4b69-aa32-7cebc40c439e", "address": "fa:16:3e:b4:92:5f", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472a1743-c9", "ovs_interfaceid": "472a1743-c919-4b69-aa32-7cebc40c439e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-50031f0d-9712-494d-96cd-7db336c33813 req-983ab6e4-deee-47bb-8465-417fda3ff7eb service nova] Releasing lock "refresh_cache-a8350c59-92c2-4348-bea4-482079ec0f5a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG nova.network.neutron [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updated VIF entry in instance network info cache for port bf280bdb-b07e-4472-b87a-304b48127d7c. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG nova.network.neutron [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updating instance_info_cache with network_info: [{"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] Releasing lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-changed-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Refreshing instance network info cache due to event network-changed-bf280bdb-b07e-4472-b87a-304b48127d7c. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] Acquiring lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] Acquired lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG nova.network.neutron [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Refreshing network info cache for port bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:02:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:41 user nova-compute[75469]: DEBUG nova.network.neutron [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updated VIF entry in instance network info cache for port bf280bdb-b07e-4472-b87a-304b48127d7c. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:02:41 user nova-compute[75469]: DEBUG nova.network.neutron [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updating instance_info_cache with network_info: [{"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10e701bb-7b13-4c64-9a6f-d1f3e0813439 req-c6e68062-31b0-427d-aece-fa867c4d8c82 service nova] Releasing lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:42 user nova-compute[75469]: WARNING nova.compute.manager [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received unexpected event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:02:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:42 user nova-compute[75469]: WARNING nova.compute.manager [req-227b869c-719d-4d43-8140-f6934a6c9d79 req-dc4f61dd-4a1d-4240-bc95-3c324d1659ff service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received unexpected event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:02:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7270e257-a76e-4866-a637-cfca11fe36da tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Received event network-vif-plugged-472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] No waiting events found dispatching network-vif-plugged-472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:44 user nova-compute[75469]: WARNING nova.compute.manager [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Received unexpected event network-vif-plugged-472a1743-c919-4b69-aa32-7cebc40c439e for instance with vm_state building and task_state spawning.
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Received event network-vif-plugged-472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] No waiting events found dispatching network-vif-plugged-472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:02:44 user nova-compute[75469]: WARNING nova.compute.manager [req-5c9724e3-98a6-4533-ae41-14da1504df41 req-32e39f5a-a7a4-491e-9e30-f7982c0314d3 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Received unexpected event network-vif-plugged-472a1743-c919-4b69-aa32-7cebc40c439e for instance with vm_state building and task_state spawning.
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:02:44 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Instance spawned successfully.
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:02:44 user nova-compute[75469]: INFO nova.compute.manager [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Took 7.88 seconds to spawn the instance on the hypervisor.
Nov 14 05:02:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:02:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:44 user nova-compute[75469]: INFO nova.compute.manager [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Took 8.77 seconds to build instance.
Nov 14 05:02:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-67c9b30d-54d9-4caa-bb63-57030bed7087 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.916s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:02:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:02:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:02:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:02:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:02:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updating instance_info_cache with network_info: [{"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:02:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-c0ca77d2-8353-4dfc-beed-ac479535b5ba" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:02:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:02:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:02:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:02:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:02:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:02:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:54 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:02:54 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:02:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7823MB free_disk=24.87659454345703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:02:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:02:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c0ca77d2-8353-4dfc-beed-ac479535b5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a48d1c5d-db49-4609-9ca4-21f4578d8943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance e052c963-4a09-4997-9689-94321a3d8af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4d0f0f5d-0fd7-4ef1-8431-e010764112ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a8350c59-92c2-4348-bea4-482079ec0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.712s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:02:55 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 05:02:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:02:56 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:02:56 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:02:56 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:02:56 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:02:56 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:02:56 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:02:56 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:02:57 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:02:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:02:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 05:02:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 05:02:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:01 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:03:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:04 user nova-compute[75469]: INFO nova.compute.manager [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Unshelving
Nov 14 05:03:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'pci_requests' on Instance uuid ff1ee641-8abc-4e0e-acfe-b48859a428da {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:03:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'numa_topology' on Instance uuid ff1ee641-8abc-4e0e-acfe-b48859a428da {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:03:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:03:04 user nova-compute[75469]: INFO nova.compute.claims [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Claim successful on node user
Nov 14 05:03:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:05 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:03:05 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:03:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:05 user nova-compute[75469]: INFO nova.network.neutron [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updating port c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 05:03:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:03:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquired lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:03:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:03:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-7c69a20b-8e5e-45b9-84c2-a911e17f3bbd req-d8b1b4c1-3b44-48fc-b0e7-c5fb296ccab1 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-changed-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-7c69a20b-8e5e-45b9-84c2-a911e17f3bbd req-d8b1b4c1-3b44-48fc-b0e7-c5fb296ccab1 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Refreshing instance network info cache due to event network-changed-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:03:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7c69a20b-8e5e-45b9-84c2-a911e17f3bbd req-d8b1b4c1-3b44-48fc-b0e7-c5fb296ccab1 service nova] Acquiring lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:03:06 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updating instance_info_cache with network_info: [{"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:03:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Releasing lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:03:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:03:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Creating image(s)
Nov 14 05:03:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "/opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "/opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:06 user nova-compute[75469]: DEBUG nova.objects.instance [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'trusted_certs' on Instance uuid ff1ee641-8abc-4e0e-acfe-b48859a428da {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:03:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7c69a20b-8e5e-45b9-84c2-a911e17f3bbd req-d8b1b4c1-3b44-48fc-b0e7-c5fb296ccab1 service nova] Acquired lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:03:06 user nova-compute[75469]: DEBUG nova.network.neutron [req-7c69a20b-8e5e-45b9-84c2-a911e17f3bbd req-d8b1b4c1-3b44-48fc-b0e7-c5fb296ccab1 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Refreshing network info cache for port c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:03:06 user nova-compute[75469]: DEBUG nova.objects.base [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Object Instance<ff1ee641-8abc-4e0e-acfe-b48859a428da> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:03:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "5b99b387032977f1f7cd50b550c3f3dbc971066c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "5b99b387032977f1f7cd50b550c3f3dbc971066c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c.part --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:07 user nova-compute[75469]: DEBUG nova.virt.images [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] 44dc6d56-4768-4a35-bb08-ea848614a458 was qcow2, converting to raw {{(pid=75469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 05:03:07 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 05:03:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c.part /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c.converted {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c.part /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c.converted" returned: 0 in 0.360s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c.converted --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:07 user nova-compute[75469]: DEBUG nova.network.neutron [req-7c69a20b-8e5e-45b9-84c2-a911e17f3bbd req-d8b1b4c1-3b44-48fc-b0e7-c5fb296ccab1 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updated VIF entry in instance network info cache for port c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:03:07 user nova-compute[75469]: DEBUG nova.network.neutron [req-7c69a20b-8e5e-45b9-84c2-a911e17f3bbd req-d8b1b4c1-3b44-48fc-b0e7-c5fb296ccab1 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updating instance_info_cache with network_info: [{"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:03:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7c69a20b-8e5e-45b9-84c2-a911e17f3bbd req-d8b1b4c1-3b44-48fc-b0e7-c5fb296ccab1 service nova] Releasing lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "5b99b387032977f1f7cd50b550c3f3dbc971066c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.773s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "5b99b387032977f1f7cd50b550c3f3dbc971066c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "5b99b387032977f1f7cd50b550c3f3dbc971066c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c,backing_fmt=raw /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c,backing_fmt=raw /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk 1073741824" returned: 0 in 0.056s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "5b99b387032977f1f7cd50b550c3f3dbc971066c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG nova.objects.instance [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'migration_context' on Instance uuid ff1ee641-8abc-4e0e-acfe-b48859a428da {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG nova.objects.base [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Object Instance<ff1ee641-8abc-4e0e-acfe-b48859a428da> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:03:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Rebasing disk image.
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 -F raw /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:09 user nova-compute[75469]: INFO nova.compute.manager [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Detaching volume 7f9066c0-70bf-484b-8812-9bd991e70a92
Nov 14 05:03:09 user nova-compute[75469]: INFO nova.virt.block_device [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Attempting to driver detach volume 7f9066c0-70bf-484b-8812-9bd991e70a92 from mountpoint /dev/vdb
Nov 14 05:03:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Attempting to detach device vdb from instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:03:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:03:09 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:03:09 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:03:09 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:03:09 user nova-compute[75469]:   <serial>7f9066c0-70bf-484b-8812-9bd991e70a92</serial>
Nov 14 05:03:09 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:03:09 user nova-compute[75469]: </disk>
Nov 14 05:03:09 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:03:09 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Successfully detached device vdb from instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f from the persistent domain config.
Nov 14 05:03:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:03:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:03:09 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:03:09 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:03:09 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:03:09 user nova-compute[75469]:   <serial>7f9066c0-70bf-484b-8812-9bd991e70a92</serial>
Nov 14 05:03:09 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:03:09 user nova-compute[75469]: </disk>
Nov 14 05:03:09 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:03:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:03:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:11 user nova-compute[75469]: INFO nova.compute.manager [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Detaching volume 63bf98e0-5edb-4cfd-99bc-13c4e57c36b8
Nov 14 05:03:11 user nova-compute[75469]: INFO nova.virt.block_device [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Attempting to driver detach volume 63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 from mountpoint /dev/vdb
Nov 14 05:03:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Attempting to detach device vdb from instance c0ca77d2-8353-4dfc-beed-ac479535b5ba from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:03:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:03:11 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:03:11 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:03:11 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:03:11 user nova-compute[75469]:   <serial>63bf98e0-5edb-4cfd-99bc-13c4e57c36b8</serial>
Nov 14 05:03:11 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:03:11 user nova-compute[75469]: </disk>
Nov 14 05:03:11 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:03:11 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Successfully detached device vdb from instance c0ca77d2-8353-4dfc-beed-ac479535b5ba from the persistent domain config.
Nov 14 05:03:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0ca77d2-8353-4dfc-beed-ac479535b5ba from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:03:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:03:11 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:03:11 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:03:11 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:03:11 user nova-compute[75469]:   <serial>63bf98e0-5edb-4cfd-99bc-13c4e57c36b8</serial>
Nov 14 05:03:11 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:03:11 user nova-compute[75469]: </disk>
Nov 14 05:03:11 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:03:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 -F raw /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk" returned: 0 in 3.145s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Ensure instance console log exists: /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Start _get_guest_xml network_info=[{"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b54768db466388989a400b5d39e8700d',container_format='bare',created_at=2023-11-14T05:01:12Z,direct_url=<?>,disk_format='qcow2',id=44dc6d56-4768-4a35-bb08-ea848614a458,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-365164676-shelved',owner='95fb1cdf42b04f37b025ed7385c4af37',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T05:01:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:03:12 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:03:12 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b54768db466388989a400b5d39e8700d',container_format='bare',created_at=2023-11-14T05:01:12Z,direct_url=<?>,disk_format='qcow2',id=44dc6d56-4768-4a35-bb08-ea848614a458,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-365164676-shelved',owner='95fb1cdf42b04f37b025ed7385c4af37',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T05:01:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'vcpu_model' on Instance uuid ff1ee641-8abc-4e0e-acfe-b48859a428da {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.objects.base [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Object Instance<ff1ee641-8abc-4e0e-acfe-b48859a428da> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T04:59:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-365164676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-365164676',id=22,image_ref='44dc6d56-4768-4a35-bb08-ea848614a458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-757025621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-a50r03tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member',shelved_at='2023-11-14T05:01:15.849344',shelved_host='user',shelved_image_id='44dc6d56-4768-4a35-bb08-ea848614a458'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:03:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=ff1ee641-8abc-4e0e-acfe-b48859a428da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'pci_devices' on Instance uuid ff1ee641-8abc-4e0e-acfe-b48859a428da {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.objects.base [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Object Instance<ff1ee641-8abc-4e0e-acfe-b48859a428da> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:03:12 user nova-compute[75469]:   <uuid>ff1ee641-8abc-4e0e-acfe-b48859a428da</uuid>
Nov 14 05:03:12 user nova-compute[75469]:   <name>instance-00000016</name>
Nov 14 05:03:12 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:03:12 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:03:12 user nova-compute[75469]:   <metadata>
Nov 14 05:03:12 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:03:12 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:03:12 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-365164676</nova:name>
Nov 14 05:03:12 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:03:12</nova:creationTime>
Nov 14 05:03:12 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:03:12 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:03:12 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:03:12 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:03:12 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:03:12 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:03:12 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:03:12 user nova-compute[75469]:       <nova:owner>
Nov 14 05:03:12 user nova-compute[75469]:         <nova:user uuid="88fb3641cda04c96b925d7b83af359b6">tempest-AttachVolumeShelveTestJSON-41564664-project-member</nova:user>
Nov 14 05:03:12 user nova-compute[75469]:         <nova:project uuid="95fb1cdf42b04f37b025ed7385c4af37">tempest-AttachVolumeShelveTestJSON-41564664</nova:project>
Nov 14 05:03:12 user nova-compute[75469]:       </nova:owner>
Nov 14 05:03:12 user nova-compute[75469]:       <nova:root type="image" uuid="44dc6d56-4768-4a35-bb08-ea848614a458"/>
Nov 14 05:03:12 user nova-compute[75469]:       <nova:ports>
Nov 14 05:03:12 user nova-compute[75469]:         <nova:port uuid="c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6">
Nov 14 05:03:12 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 05:03:12 user nova-compute[75469]:         </nova:port>
Nov 14 05:03:12 user nova-compute[75469]:       </nova:ports>
Nov 14 05:03:12 user nova-compute[75469]:     </nova:instance>
Nov 14 05:03:12 user nova-compute[75469]:   </metadata>
Nov 14 05:03:12 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:03:12 user nova-compute[75469]:     <system>
Nov 14 05:03:12 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:03:12 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:03:12 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:03:12 user nova-compute[75469]:       <entry name="serial">ff1ee641-8abc-4e0e-acfe-b48859a428da</entry>
Nov 14 05:03:12 user nova-compute[75469]:       <entry name="uuid">ff1ee641-8abc-4e0e-acfe-b48859a428da</entry>
Nov 14 05:03:12 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:03:12 user nova-compute[75469]:     </system>
Nov 14 05:03:12 user nova-compute[75469]:   </sysinfo>
Nov 14 05:03:12 user nova-compute[75469]:   <os>
Nov 14 05:03:12 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:03:12 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:03:12 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:03:12 user nova-compute[75469]:   </os>
Nov 14 05:03:12 user nova-compute[75469]:   <features>
Nov 14 05:03:12 user nova-compute[75469]:     <acpi/>
Nov 14 05:03:12 user nova-compute[75469]:     <apic/>
Nov 14 05:03:12 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:03:12 user nova-compute[75469]:   </features>
Nov 14 05:03:12 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:03:12 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:03:12 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:03:12 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:03:12 user nova-compute[75469]:   </clock>
Nov 14 05:03:12 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:03:12 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:03:12 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:03:12 user nova-compute[75469]:   </cpu>
Nov 14 05:03:12 user nova-compute[75469]:   <devices>
Nov 14 05:03:12 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:03:12 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:03:12 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk"/>
Nov 14 05:03:12 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:03:12 user nova-compute[75469]:     </disk>
Nov 14 05:03:12 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:03:12 user nova-compute[75469]:       <mac address="fa:16:3e:f5:7d:1b"/>
Nov 14 05:03:12 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:03:12 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:03:12 user nova-compute[75469]:       <target dev="tapc3e0b05c-1e"/>
Nov 14 05:03:12 user nova-compute[75469]:     </interface>
Nov 14 05:03:12 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:03:12 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/console.log" append="off"/>
Nov 14 05:03:12 user nova-compute[75469]:     </serial>
Nov 14 05:03:12 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:03:12 user nova-compute[75469]:     <video>
Nov 14 05:03:12 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:03:12 user nova-compute[75469]:     </video>
Nov 14 05:03:12 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:03:12 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:03:12 user nova-compute[75469]:     </rng>
Nov 14 05:03:12 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:03:12 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:03:12 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:03:12 user nova-compute[75469]:     </memballoon>
Nov 14 05:03:12 user nova-compute[75469]:   </devices>
Nov 14 05:03:12 user nova-compute[75469]: </domain>
Nov 14 05:03:12 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T04:59:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-365164676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-365164676',id=22,image_ref='44dc6d56-4768-4a35-bb08-ea848614a458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-757025621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-a50r03tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member',shelved_at='2023-11-14T05:01:15.849344',shelved_host='user',shelved_image_id='44dc6d56-4768-4a35-bb08-ea848614a458'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:03:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=ff1ee641-8abc-4e0e-acfe-b48859a428da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG os_vif [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27694c5c-a9b1-59d5-b7e6-aad9d2cbc052', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3e0b05c-1e, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3e0b05c-1e, col_values=(('qos', UUID('e20732aa-0d6c-4ecb-a88d-68a9855bcac4')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3e0b05c-1e, col_values=(('external_ids', {'iface-id': 'c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:7d:1b', 'vm-uuid': 'ff1ee641-8abc-4e0e-acfe-b48859a428da'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:12 user nova-compute[75469]: INFO os_vif [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e')
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:03:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] No VIF found with MAC fa:16:3e:f5:7d:1b, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:03:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:14 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:03:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:14 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:03:14 user nova-compute[75469]: INFO nova.compute.claims [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Claim successful on node user
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:03:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:03:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:03:15 user nova-compute[75469]: INFO nova.virt.block_device [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Booting with volume snapshot 195114cc-1122-4a2d-90f2-747359e44910 at /dev/vda
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:03:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Instance spawned successfully.
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.policy [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0155ca3745514d6c8c0ab08a9182df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf022cc839af44ff89e4249410c4a9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-75ef5974-11c9-4be4-ad31-e1dad41b88a5 req-7149cb96-72fe-4446-b17c-39d80168aba8 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-75ef5974-11c9-4be4-ad31-e1dad41b88a5 req-7149cb96-72fe-4446-b17c-39d80168aba8 service nova] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-75ef5974-11c9-4be4-ad31-e1dad41b88a5 req-7149cb96-72fe-4446-b17c-39d80168aba8 service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-75ef5974-11c9-4be4-ad31-e1dad41b88a5 req-7149cb96-72fe-4446-b17c-39d80168aba8 service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-75ef5974-11c9-4be4-ad31-e1dad41b88a5 req-7149cb96-72fe-4446-b17c-39d80168aba8 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] No waiting events found dispatching network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:03:15 user nova-compute[75469]: WARNING nova.compute.manager [req-75ef5974-11c9-4be4-ad31-e1dad41b88a5 req-7149cb96-72fe-4446-b17c-39d80168aba8 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received unexpected event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 05:03:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:03:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6be19477-11c7-4188-9d90-8975a44ddf81 tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.425s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Successfully created port: 82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:03:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Successfully updated port: 82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:03:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "refresh_cache-bedf3e65-8970-47a2-9a96-d8fcc14016e5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:03:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquired lock "refresh_cache-bedf3e65-8970-47a2-9a96-d8fcc14016e5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:03:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:03:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-927621a3-c12d-47ff-9191-8c976fb99729 req-dbc1d518-f798-4676-99e2-6af82eca179d service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Received event network-changed-82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-927621a3-c12d-47ff-9191-8c976fb99729 req-dbc1d518-f798-4676-99e2-6af82eca179d service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Refreshing instance network info cache due to event network-changed-82213486-add3-44cd-ae78-b7768d777154. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:03:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-927621a3-c12d-47ff-9191-8c976fb99729 req-dbc1d518-f798-4676-99e2-6af82eca179d service nova] Acquiring lock "refresh_cache-bedf3e65-8970-47a2-9a96-d8fcc14016e5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:03:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Updating instance_info_cache with network_info: [{"id": "82213486-add3-44cd-ae78-b7768d777154", "address": "fa:16:3e:6c:75:46", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82213486-ad", "ovs_interfaceid": "82213486-add3-44cd-ae78-b7768d777154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Releasing lock "refresh_cache-bedf3e65-8970-47a2-9a96-d8fcc14016e5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Instance network_info: |[{"id": "82213486-add3-44cd-ae78-b7768d777154", "address": "fa:16:3e:6c:75:46", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82213486-ad", "ovs_interfaceid": "82213486-add3-44cd-ae78-b7768d777154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-927621a3-c12d-47ff-9191-8c976fb99729 req-dbc1d518-f798-4676-99e2-6af82eca179d service nova] Acquired lock "refresh_cache-bedf3e65-8970-47a2-9a96-d8fcc14016e5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-927621a3-c12d-47ff-9191-8c976fb99729 req-dbc1d518-f798-4676-99e2-6af82eca179d service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Refreshing network info cache for port 82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-927621a3-c12d-47ff-9191-8c976fb99729 req-dbc1d518-f798-4676-99e2-6af82eca179d service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Updated VIF entry in instance network info cache for port 82213486-add3-44cd-ae78-b7768d777154. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-927621a3-c12d-47ff-9191-8c976fb99729 req-dbc1d518-f798-4676-99e2-6af82eca179d service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Updating instance_info_cache with network_info: [{"id": "82213486-add3-44cd-ae78-b7768d777154", "address": "fa:16:3e:6c:75:46", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82213486-ad", "ovs_interfaceid": "82213486-add3-44cd-ae78-b7768d777154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-927621a3-c12d-47ff-9191-8c976fb99729 req-dbc1d518-f798-4676-99e2-6af82eca179d service nova] Releasing lock "refresh_cache-bedf3e65-8970-47a2-9a96-d8fcc14016e5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-e2b9931c-d428-4bfa-85d0-f07b2612745e req-b1c566af-75c6-4f05-8b31-d62c7009a287 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e2b9931c-d428-4bfa-85d0-f07b2612745e req-b1c566af-75c6-4f05-8b31-d62c7009a287 service nova] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e2b9931c-d428-4bfa-85d0-f07b2612745e req-b1c566af-75c6-4f05-8b31-d62c7009a287 service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e2b9931c-d428-4bfa-85d0-f07b2612745e req-b1c566af-75c6-4f05-8b31-d62c7009a287 service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-e2b9931c-d428-4bfa-85d0-f07b2612745e req-b1c566af-75c6-4f05-8b31-d62c7009a287 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] No waiting events found dispatching network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:03:17 user nova-compute[75469]: WARNING nova.compute.manager [req-e2b9931c-d428-4bfa-85d0-f07b2612745e req-b1c566af-75c6-4f05-8b31-d62c7009a287 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received unexpected event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 for instance with vm_state active and task_state None.
Nov 14 05:03:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "c07c6b3f-e748-4a36-a018-2336000b716d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:03:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:03:20 user nova-compute[75469]: INFO nova.compute.claims [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Claim successful on node user
Nov 14 05:03:20 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:03:20 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:03:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:03:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:03:20 user nova-compute[75469]: DEBUG nova.network.neutron [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:03:20 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:03:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG nova.policy [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a23a8feda3e4d7581666ca3ee20aa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e392b9dd841a4eacab6c4aff4f60e536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:03:21 user nova-compute[75469]: INFO nova.virt.block_device [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Booting with volume-backed-image 7b828d08-5de0-47b5-a30d-5095d166987a at /dev/vda
Nov 14 05:03:21 user nova-compute[75469]: DEBUG os_brick.utils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[23944b11-22cc-48da-a975-9e296d9de2fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9650bf37-939a-40f5-a8d4-574a15a63901]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.042s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2d8d57-60f9-447e-af06-bba9b5f76550]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b18394e-1355-43db-933c-e24548776ba8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:03:21 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:03:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16d5c51-a10a-4b43-98ca-d2fedf7edec7]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG os_brick.utils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Updating existing volume attachment record: a4d5305f-fdb4-4330-baee-b289bf641982 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:03:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Successfully created port: 9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:03:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:03:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Successfully updated port: 9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:03:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:03:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquired lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:03:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:03:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-02a082af-e9bd-4916-922e-23627c6253f0 req-eed8b907-16f8-4ce6-b814-bd248021a3d7 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-changed-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-02a082af-e9bd-4916-922e-23627c6253f0 req-eed8b907-16f8-4ce6-b814-bd248021a3d7 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Refreshing instance network info cache due to event network-changed-9e47e54c-fc40-4577-bb19-f8f9c6a73a68. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:03:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-02a082af-e9bd-4916-922e-23627c6253f0 req-eed8b907-16f8-4ce6-b814-bd248021a3d7 service nova] Acquiring lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:03:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:03:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Updating instance_info_cache with network_info: [{"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:03:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Releasing lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:03:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Instance network_info: |[{"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:03:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-02a082af-e9bd-4916-922e-23627c6253f0 req-eed8b907-16f8-4ce6-b814-bd248021a3d7 service nova] Acquired lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:03:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-02a082af-e9bd-4916-922e-23627c6253f0 req-eed8b907-16f8-4ce6-b814-bd248021a3d7 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Refreshing network info cache for port 9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:03:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-02a082af-e9bd-4916-922e-23627c6253f0 req-eed8b907-16f8-4ce6-b814-bd248021a3d7 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Updated VIF entry in instance network info cache for port 9e47e54c-fc40-4577-bb19-f8f9c6a73a68. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:03:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-02a082af-e9bd-4916-922e-23627c6253f0 req-eed8b907-16f8-4ce6-b814-bd248021a3d7 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Updating instance_info_cache with network_info: [{"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:03:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-02a082af-e9bd-4916-922e-23627c6253f0 req-eed8b907-16f8-4ce6-b814-bd248021a3d7 service nova] Releasing lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:03:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Creating image(s)
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Ensure instance console log exists: /opt/stack/data/nova/instances/bedf3e65-8970-47a2-9a96-d8fcc14016e5/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Start _get_guest_xml network_info=[{"id": "82213486-add3-44cd-ae78-b7768d777154", "address": "fa:16:3e:6c:75:46", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82213486-ad", "ovs_interfaceid": "82213486-add3-44cd-ae78-b7768d777154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'a4d5305f-fdb4-4330-baee-b289bf641982', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSlPLHQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bedf3e65-8970-47a2-9a96-d8fcc14016e5', 'attached_at': '', 'detached_at': '', 'volume_id': '34897bc0-9ccd-4cba-b347-28e03f5abcbd', 'serial': '34897bc0-9ccd-4cba-b347-28e03f5abcbd'}, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:03:26 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:03:26 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSlPLHQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:03:26 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:03:26 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:03:26 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[20733591-2030-495b-9540-aa8f1b9221fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:03:26 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc649fa1-0294-4d0a-bac1-a7484824f83c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd] added
Nov 14 05:03:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f44a13a-250b-4a20-8df8-a4d2d4821a64]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9270b522-6897-453f-b6d2-f6c081be7916]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSlPLHQb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSlPLHQb" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2d1f23-d528-48ec-a981-2148d53ad379]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uSlPLHQb'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb476afb-9b8c-4c1c-b13b-784c3eeb5300]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fc1586-2a25-49a9-87ba-a65761d6e5d2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a754b212-81e2-4d70-9b55-fa7fe3334df8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd, portal: 172.16.0.220,3260]
Nov 14 05:03:26 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd, portal: 172.16.0.220,3260] successful.
Nov 14 05:03:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab587a35-1a02-495e-bfca-1d9306cfdcca]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19c4910-c25e-4b20-b9e1-61414071c0eb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:03:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:03:26 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:03:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ae12d6-a67b-4527-bb54-433d34b81c0c]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.utils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[55004144-3133-4570-8606-2922f6532e6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3992c56-f5e6-4e35-b96a-2a9012527401]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddd30ee-ba06-4e2b-bbb0-eec411605077]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdf711a-f510-4cf0-b42d-26b9d1672fbd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:03:26 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:03:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc9b814-9a4c-40b3-a56b-9dcf1162aa2d]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG os_brick.utils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:03:26 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Updating existing volume attachment record: de47916e-29e3-4aed-9b1a-8d48505517fe {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSlPLHQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26335323636313939', 'path': '/dev/sdd'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335323636313939', 'path': '/dev/sdd'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1296212139',display_name='tempest-TestVolumeBootPattern-server-1296212139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1296212139',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-5oimly20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:03:15Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=bedf3e65-8970-47a2-9a96-d8fcc14016e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82213486-add3-44cd-ae78-b7768d777154", "address": "fa:16:3e:6c:75:46", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82213486-ad", "ovs_interfaceid": "82213486-add3-44cd-ae78-b7768d777154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "82213486-add3-44cd-ae78-b7768d777154", "address": "fa:16:3e:6c:75:46", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82213486-ad", "ovs_interfaceid": "82213486-add3-44cd-ae78-b7768d777154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=82213486-add3-44cd-ae78-b7768d777154,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82213486-ad') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'pci_devices' on Instance uuid bedf3e65-8970-47a2-9a96-d8fcc14016e5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:03:27 user nova-compute[75469]:   <uuid>bedf3e65-8970-47a2-9a96-d8fcc14016e5</uuid>
Nov 14 05:03:27 user nova-compute[75469]:   <name>instance-0000001e</name>
Nov 14 05:03:27 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:03:27 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:03:27 user nova-compute[75469]:   <metadata>
Nov 14 05:03:27 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:03:27 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:03:27 user nova-compute[75469]:       <nova:name>tempest-TestVolumeBootPattern-server-1296212139</nova:name>
Nov 14 05:03:27 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:03:26</nova:creationTime>
Nov 14 05:03:27 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:03:27 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:03:27 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:03:27 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:03:27 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:03:27 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:03:27 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:03:27 user nova-compute[75469]:       <nova:owner>
Nov 14 05:03:27 user nova-compute[75469]:         <nova:user uuid="0155ca3745514d6c8c0ab08a9182df53">tempest-TestVolumeBootPattern-43343925-project-member</nova:user>
Nov 14 05:03:27 user nova-compute[75469]:         <nova:project uuid="bf022cc839af44ff89e4249410c4a9e4">tempest-TestVolumeBootPattern-43343925</nova:project>
Nov 14 05:03:27 user nova-compute[75469]:       </nova:owner>
Nov 14 05:03:27 user nova-compute[75469]:       <nova:ports>
Nov 14 05:03:27 user nova-compute[75469]:         <nova:port uuid="82213486-add3-44cd-ae78-b7768d777154">
Nov 14 05:03:27 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 05:03:27 user nova-compute[75469]:         </nova:port>
Nov 14 05:03:27 user nova-compute[75469]:       </nova:ports>
Nov 14 05:03:27 user nova-compute[75469]:     </nova:instance>
Nov 14 05:03:27 user nova-compute[75469]:   </metadata>
Nov 14 05:03:27 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:03:27 user nova-compute[75469]:     <system>
Nov 14 05:03:27 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:03:27 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:03:27 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:03:27 user nova-compute[75469]:       <entry name="serial">bedf3e65-8970-47a2-9a96-d8fcc14016e5</entry>
Nov 14 05:03:27 user nova-compute[75469]:       <entry name="uuid">bedf3e65-8970-47a2-9a96-d8fcc14016e5</entry>
Nov 14 05:03:27 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:03:27 user nova-compute[75469]:     </system>
Nov 14 05:03:27 user nova-compute[75469]:   </sysinfo>
Nov 14 05:03:27 user nova-compute[75469]:   <os>
Nov 14 05:03:27 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:03:27 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:03:27 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:03:27 user nova-compute[75469]:   </os>
Nov 14 05:03:27 user nova-compute[75469]:   <features>
Nov 14 05:03:27 user nova-compute[75469]:     <acpi/>
Nov 14 05:03:27 user nova-compute[75469]:     <apic/>
Nov 14 05:03:27 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:03:27 user nova-compute[75469]:   </features>
Nov 14 05:03:27 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:03:27 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:03:27 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:03:27 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:03:27 user nova-compute[75469]:   </clock>
Nov 14 05:03:27 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:03:27 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:03:27 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:03:27 user nova-compute[75469]:   </cpu>
Nov 14 05:03:27 user nova-compute[75469]:   <devices>
Nov 14 05:03:27 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:03:27 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:03:27 user nova-compute[75469]:       <source dev="/dev/sdd"/>
Nov 14 05:03:27 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:03:27 user nova-compute[75469]:       <serial>34897bc0-9ccd-4cba-b347-28e03f5abcbd</serial>
Nov 14 05:03:27 user nova-compute[75469]:     </disk>
Nov 14 05:03:27 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:03:27 user nova-compute[75469]:       <mac address="fa:16:3e:6c:75:46"/>
Nov 14 05:03:27 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:03:27 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:03:27 user nova-compute[75469]:       <target dev="tap82213486-ad"/>
Nov 14 05:03:27 user nova-compute[75469]:     </interface>
Nov 14 05:03:27 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:03:27 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/bedf3e65-8970-47a2-9a96-d8fcc14016e5/console.log" append="off"/>
Nov 14 05:03:27 user nova-compute[75469]:     </serial>
Nov 14 05:03:27 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:03:27 user nova-compute[75469]:     <video>
Nov 14 05:03:27 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:03:27 user nova-compute[75469]:     </video>
Nov 14 05:03:27 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:03:27 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:03:27 user nova-compute[75469]:     </rng>
Nov 14 05:03:27 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:03:27 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:03:27 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:03:27 user nova-compute[75469]:     </memballoon>
Nov 14 05:03:27 user nova-compute[75469]:   </devices>
Nov 14 05:03:27 user nova-compute[75469]: </domain>
Nov 14 05:03:27 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1296212139',display_name='tempest-TestVolumeBootPattern-server-1296212139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1296212139',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-5oimly20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:03:15Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=bedf3e65-8970-47a2-9a96-d8fcc14016e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82213486-add3-44cd-ae78-b7768d777154", "address": "fa:16:3e:6c:75:46", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82213486-ad", "ovs_interfaceid": "82213486-add3-44cd-ae78-b7768d777154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "82213486-add3-44cd-ae78-b7768d777154", "address": "fa:16:3e:6c:75:46", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82213486-ad", "ovs_interfaceid": "82213486-add3-44cd-ae78-b7768d777154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=82213486-add3-44cd-ae78-b7768d777154,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82213486-ad') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG os_vif [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=82213486-add3-44cd-ae78-b7768d777154,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82213486-ad') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09d97850-b8c0-568f-bd7c-5f3d5a33959f', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82213486-ad, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82213486-ad, col_values=(('qos', UUID('3784d097-3dbe-424d-a8ab-115e37bd9a4a')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82213486-ad, col_values=(('external_ids', {'iface-id': '82213486-add3-44cd-ae78-b7768d777154', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:75:46', 'vm-uuid': 'bedf3e65-8970-47a2-9a96-d8fcc14016e5'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:27 user nova-compute[75469]: INFO os_vif [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=82213486-add3-44cd-ae78-b7768d777154,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82213486-ad')
Nov 14 05:03:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:03:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No VIF found with MAC fa:16:3e:6c:75:46, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:03:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-d3ec54d0-985e-4039-9861-cec75deaaad0 req-9ba81f0c-b67f-4dc0-84e2-b4cbfa84c85b service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Received event network-vif-plugged-82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d3ec54d0-985e-4039-9861-cec75deaaad0 req-9ba81f0c-b67f-4dc0-84e2-b4cbfa84c85b service nova] Acquiring lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d3ec54d0-985e-4039-9861-cec75deaaad0 req-9ba81f0c-b67f-4dc0-84e2-b4cbfa84c85b service nova] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d3ec54d0-985e-4039-9861-cec75deaaad0 req-9ba81f0c-b67f-4dc0-84e2-b4cbfa84c85b service nova] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-d3ec54d0-985e-4039-9861-cec75deaaad0 req-9ba81f0c-b67f-4dc0-84e2-b4cbfa84c85b service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] No waiting events found dispatching network-vif-plugged-82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:03:29 user nova-compute[75469]: WARNING nova.compute.manager [req-d3ec54d0-985e-4039-9861-cec75deaaad0 req-9ba81f0c-b67f-4dc0-84e2-b4cbfa84c85b service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Received unexpected event network-vif-plugged-82213486-add3-44cd-ae78-b7768d777154 for instance with vm_state building and task_state spawning.
Nov 14 05:03:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f is timed out.
Nov 14 05:03:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Successfully detached device vdb from instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f from the live domain config.
Nov 14 05:03:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqpYLeiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:03:30 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df5d024-3d35-40c4-b621-16e229a761b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:03:30 user nova-compute[75469]: No targets found.
Nov 14 05:03:30 user nova-compute[75469]: iSNS:
Nov 14 05:03:30 user nova-compute[75469]: No targets found.
Nov 14 05:03:30 user nova-compute[75469]: STATIC:
Nov 14 05:03:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd
Nov 14 05:03:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:03:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:03:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8
Nov 14 05:03:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:03:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:03:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92
Nov 14 05:03:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:03:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:03:30 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:03:30 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:03:30 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:03:30 user nova-compute[75469]: FIRMWARE:
Nov 14 05:03:30 user nova-compute[75469]: No targets found.
Nov 14 05:03:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:03:30 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:03:30 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[257f253c-9467-46c9-ac02-71806d9e37e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd448da-a73f-4833-95c4-ecd184bf5c30]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:30 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:03:30 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:03:30 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:03:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:30 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:03:30 user nova-compute[75469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 (non-flash)
Nov 14 05:03:30 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:03:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c2960e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[babe05c7-c2f3-418d-841a-957a940dd5e8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c531acf3-14a5-4ca0-b6e6-2e6dadba0c56]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e8ce1d-f576-4aef-ad33-ef8b83c85954]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd945525-7244-4321-bb86-d6fe2f5b6710]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a2a5fb-8284-4cfc-9bff-513b64ecdaa8]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdeeecc-a580-455d-840a-9a38165a1101]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92, portal: 172.16.0.220,3260]
Nov 14 05:03:30 user nova-compute[75469]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92, portal: 172.16.0.220,3260] successful.
Nov 14 05:03:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9066c0-70bf-484b-8812-9bd991e70a92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93296e8-433a-4821-81ca-d5550fdfba4c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] <== disconnect_volume: return (320ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:03:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:03:31 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Instance spawned successfully.
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:31 user nova-compute[75469]: INFO nova.compute.manager [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:03:31 user nova-compute[75469]: INFO nova.compute.manager [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Took 16.39 seconds to build instance.
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ace0bd19-5db9-4d10-ab51-6fb5ae356c6a tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.492s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-f157c427-2107-4954-8b90-b03eedeac5ab req-d3b50efd-2bc5-4155-a183-7a9928972765 service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Received event network-vif-plugged-82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f157c427-2107-4954-8b90-b03eedeac5ab req-d3b50efd-2bc5-4155-a183-7a9928972765 service nova] Acquiring lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f157c427-2107-4954-8b90-b03eedeac5ab req-d3b50efd-2bc5-4155-a183-7a9928972765 service nova] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f157c427-2107-4954-8b90-b03eedeac5ab req-d3b50efd-2bc5-4155-a183-7a9928972765 service nova] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-f157c427-2107-4954-8b90-b03eedeac5ab req-d3b50efd-2bc5-4155-a183-7a9928972765 service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] No waiting events found dispatching network-vif-plugged-82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:03:31 user nova-compute[75469]: WARNING nova.compute.manager [req-f157c427-2107-4954-8b90-b03eedeac5ab req-d3b50efd-2bc5-4155-a183-7a9928972765 service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Received unexpected event network-vif-plugged-82213486-add3-44cd-ae78-b7768d777154 for instance with vm_state active and task_state None.
Nov 14 05:03:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.objects.instance [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lazy-loading 'flavor' on Instance uuid 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:03:31 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c0ca77d2-8353-4dfc-beed-ac479535b5ba is timed out.
Nov 14 05:03:31 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Successfully detached device vdb from instance c0ca77d2-8353-4dfc-beed-ac479535b5ba from the live domain config.
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-def66263-0dd7-4a3d-b110-ca0474843f83 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.597s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkvZjMYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:03:31 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f21120-4f67-4828-ae42-ee8a2dca8e8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:03:31 user nova-compute[75469]: No targets found.
Nov 14 05:03:31 user nova-compute[75469]: iSNS:
Nov 14 05:03:31 user nova-compute[75469]: No targets found.
Nov 14 05:03:31 user nova-compute[75469]: STATIC:
Nov 14 05:03:31 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd
Nov 14 05:03:31 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:03:31 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:03:31 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8
Nov 14 05:03:31 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:03:31 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:03:31 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:03:31 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:03:31 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:03:31 user nova-compute[75469]: FIRMWARE:
Nov 14 05:03:31 user nova-compute[75469]: No targets found.
Nov 14 05:03:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:03:31 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:03:31 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0868309-5d21-4053-b7d9-01a52ac22152]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[666ae855-f0b2-48bc-94a5-5c5052d55b11]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:31 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:03:31 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:03:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:31 user nova-compute[75469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 (non-flash)
Nov 14 05:03:31 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:03:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c5e77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8'): ({'sde'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Removing single pathed devices sde {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8848869-8f36-47cf-bbd6-bc9b56eeba89]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceb7fc8-1433-4d74-8958-9bc4a5d1d76b]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Flushing IO for device /dev/sde {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ade521-0053-44dd-88f4-3880e365d81a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[01824e98-944b-4166-81fb-f870702bc093]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[21462878-155f-48e4-808a-633684da11c5]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaed2f2-3372-4525-8c1f-f407dbf87e39]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8, portal: 172.16.0.220,3260]
Nov 14 05:03:32 user nova-compute[75469]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8, portal: 172.16.0.220,3260] successful.
Nov 14 05:03:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63bf98e0-5edb-4cfd-99bc-13c4e57c36b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94694586-6b80-4dd3-895f-b5bfd15818b1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] <== disconnect_volume: return (305ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:03:32 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Creating image(s)
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Ensure instance console log exists: /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Start _get_guest_xml network_info=[{"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'de47916e-29e3-4aed-9b1a-8d48505517fe', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCGaAeQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c07c6b3f-e748-4a36-a018-2336000b716d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c09ea236-173a-42bb-8248-490aef5baba5', 'serial': 'c09ea236-173a-42bb-8248-490aef5baba5'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:03:32 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:03:32 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCGaAeQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:03:32 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:03:32 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:03:32 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7c6f91-0207-496d-a9b5-c63e4b8b4412]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:03:32 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a295fa-4a33-47da-8437-b70fda42ed94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5] added
Nov 14 05:03:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3550d03-616a-43d9-9b6b-3857b494b78f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e27806-7081-4874-bb8c-674b91bd0542]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCGaAeQg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCGaAeQg" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c53706-f584-4600-9ee7-1787db4764d5]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UCGaAeQg'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[342194cc-a5ee-4c22-a81e-42d7aca488aa]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a2b99e-7ca3-499f-9196-e3daee0dc6e0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:32 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:03:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:32 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:03:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c363f2-2147-4c3b-aec8-e017afe686a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5, portal: 172.16.0.220,3260]
Nov 14 05:03:32 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5, portal: 172.16.0.220,3260] successful.
Nov 14 05:03:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0134f8-65a6-4b91-8f05-3c3dd0dcb185]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca02b7a7-dba7-40c4-8034-6c17af0515b3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:32 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:03:32 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:03:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:03:32 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:03:32 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:03:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[842b2c7d-2eac-4317-889c-e72741f97444]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCGaAeQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG nova.objects.instance [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'flavor' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:03:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c6bdc346-da67-4597-8f75-2cd9db5a5467 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.805s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23335346261356436', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335346261356436', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:03:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-96373400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-96373400',id=31,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-6ra00e0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:03:21Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=c07c6b3f-e748-4a36-a018-2336000b716d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e9:2e,bridge_name='br-int',has_traffic_filtering=True,id=9e47e54c-fc40-4577-bb19-f8f9c6a73a68,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e47e54c-fc') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG nova.objects.instance [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'pci_devices' on Instance uuid c07c6b3f-e748-4a36-a018-2336000b716d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:03:33 user nova-compute[75469]:   <uuid>c07c6b3f-e748-4a36-a018-2336000b716d</uuid>
Nov 14 05:03:33 user nova-compute[75469]:   <name>instance-0000001f</name>
Nov 14 05:03:33 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:03:33 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:03:33 user nova-compute[75469]:   <metadata>
Nov 14 05:03:33 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:03:33 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:03:33 user nova-compute[75469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-96373400</nova:name>
Nov 14 05:03:33 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:03:32</nova:creationTime>
Nov 14 05:03:33 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:03:33 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:03:33 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:03:33 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:03:33 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:03:33 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:03:33 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:03:33 user nova-compute[75469]:       <nova:owner>
Nov 14 05:03:33 user nova-compute[75469]:         <nova:user uuid="3a23a8feda3e4d7581666ca3ee20aa5f">tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member</nova:user>
Nov 14 05:03:33 user nova-compute[75469]:         <nova:project uuid="e392b9dd841a4eacab6c4aff4f60e536">tempest-ServerBootFromVolumeStableRescueTest-1634984639</nova:project>
Nov 14 05:03:33 user nova-compute[75469]:       </nova:owner>
Nov 14 05:03:33 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:03:33 user nova-compute[75469]:       <nova:ports>
Nov 14 05:03:33 user nova-compute[75469]:         <nova:port uuid="9e47e54c-fc40-4577-bb19-f8f9c6a73a68">
Nov 14 05:03:33 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 05:03:33 user nova-compute[75469]:         </nova:port>
Nov 14 05:03:33 user nova-compute[75469]:       </nova:ports>
Nov 14 05:03:33 user nova-compute[75469]:     </nova:instance>
Nov 14 05:03:33 user nova-compute[75469]:   </metadata>
Nov 14 05:03:33 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:03:33 user nova-compute[75469]:     <system>
Nov 14 05:03:33 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:03:33 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:03:33 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:03:33 user nova-compute[75469]:       <entry name="serial">c07c6b3f-e748-4a36-a018-2336000b716d</entry>
Nov 14 05:03:33 user nova-compute[75469]:       <entry name="uuid">c07c6b3f-e748-4a36-a018-2336000b716d</entry>
Nov 14 05:03:33 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:03:33 user nova-compute[75469]:     </system>
Nov 14 05:03:33 user nova-compute[75469]:   </sysinfo>
Nov 14 05:03:33 user nova-compute[75469]:   <os>
Nov 14 05:03:33 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:03:33 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:03:33 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:03:33 user nova-compute[75469]:   </os>
Nov 14 05:03:33 user nova-compute[75469]:   <features>
Nov 14 05:03:33 user nova-compute[75469]:     <acpi/>
Nov 14 05:03:33 user nova-compute[75469]:     <apic/>
Nov 14 05:03:33 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:03:33 user nova-compute[75469]:   </features>
Nov 14 05:03:33 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:03:33 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:03:33 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:03:33 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:03:33 user nova-compute[75469]:   </clock>
Nov 14 05:03:33 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:03:33 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:03:33 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:03:33 user nova-compute[75469]:   </cpu>
Nov 14 05:03:33 user nova-compute[75469]:   <devices>
Nov 14 05:03:33 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:03:33 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:03:33 user nova-compute[75469]:       <source dev="/dev/sdb"/>
Nov 14 05:03:33 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:03:33 user nova-compute[75469]:       <serial>c09ea236-173a-42bb-8248-490aef5baba5</serial>
Nov 14 05:03:33 user nova-compute[75469]:     </disk>
Nov 14 05:03:33 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:03:33 user nova-compute[75469]:       <mac address="fa:16:3e:e0:e9:2e"/>
Nov 14 05:03:33 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:03:33 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:03:33 user nova-compute[75469]:       <target dev="tap9e47e54c-fc"/>
Nov 14 05:03:33 user nova-compute[75469]:     </interface>
Nov 14 05:03:33 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:03:33 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/console.log" append="off"/>
Nov 14 05:03:33 user nova-compute[75469]:     </serial>
Nov 14 05:03:33 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:03:33 user nova-compute[75469]:     <video>
Nov 14 05:03:33 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:03:33 user nova-compute[75469]:     </video>
Nov 14 05:03:33 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:03:33 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:03:33 user nova-compute[75469]:     </rng>
Nov 14 05:03:33 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:03:33 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:03:33 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:03:33 user nova-compute[75469]:     </memballoon>
Nov 14 05:03:33 user nova-compute[75469]:   </devices>
Nov 14 05:03:33 user nova-compute[75469]: </domain>
Nov 14 05:03:33 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:03:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-96373400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-96373400',id=31,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-6ra00e0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:03:21Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=c07c6b3f-e748-4a36-a018-2336000b716d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e9:2e,bridge_name='br-int',has_traffic_filtering=True,id=9e47e54c-fc40-4577-bb19-f8f9c6a73a68,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e47e54c-fc') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG os_vif [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e9:2e,bridge_name='br-int',has_traffic_filtering=True,id=9e47e54c-fc40-4577-bb19-f8f9c6a73a68,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e47e54c-fc') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a74f4ebd-87f1-5f45-8aab-f1459d726a53', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e47e54c-fc, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e47e54c-fc, col_values=(('qos', UUID('531758a2-53f2-40a9-80ab-3084ff6dd4e9')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e47e54c-fc, col_values=(('external_ids', {'iface-id': '9e47e54c-fc40-4577-bb19-f8f9c6a73a68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:e9:2e', 'vm-uuid': 'c07c6b3f-e748-4a36-a018-2336000b716d'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:33 user nova-compute[75469]: INFO os_vif [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e9:2e,bridge_name='br-int',has_traffic_filtering=True,id=9e47e54c-fc40-4577-bb19-f8f9c6a73a68,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e47e54c-fc')
Nov 14 05:03:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:03:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No VIF found with MAC fa:16:3e:e0:e9:2e, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:03:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:35 user nova-compute[75469]: DEBUG nova.compute.manager [req-d7ac4806-cc9d-42fb-944d-53f4451c1fbc req-b3872a14-6935-47fe-a45c-c27911759c2c service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d7ac4806-cc9d-42fb-944d-53f4451c1fbc req-b3872a14-6935-47fe-a45c-c27911759c2c service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d7ac4806-cc9d-42fb-944d-53f4451c1fbc req-b3872a14-6935-47fe-a45c-c27911759c2c service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d7ac4806-cc9d-42fb-944d-53f4451c1fbc req-b3872a14-6935-47fe-a45c-c27911759c2c service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:35 user nova-compute[75469]: DEBUG nova.compute.manager [req-d7ac4806-cc9d-42fb-944d-53f4451c1fbc req-b3872a14-6935-47fe-a45c-c27911759c2c service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:03:35 user nova-compute[75469]: WARNING nova.compute.manager [req-d7ac4806-cc9d-42fb-944d-53f4451c1fbc req-b3872a14-6935-47fe-a45c-c27911759c2c service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received unexpected event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with vm_state building and task_state spawning.
Nov 14 05:03:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:03:37 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Instance spawned successfully.
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:03:37 user nova-compute[75469]: INFO nova.compute.manager [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-872dbdf9-336e-4836-a508-19fa2e6e47cf req-2ecfa955-6c21-4eb4-84d1-9300f18b881a service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-872dbdf9-336e-4836-a508-19fa2e6e47cf req-2ecfa955-6c21-4eb4-84d1-9300f18b881a service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-872dbdf9-336e-4836-a508-19fa2e6e47cf req-2ecfa955-6c21-4eb4-84d1-9300f18b881a service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-872dbdf9-336e-4836-a508-19fa2e6e47cf req-2ecfa955-6c21-4eb4-84d1-9300f18b881a service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-872dbdf9-336e-4836-a508-19fa2e6e47cf req-2ecfa955-6c21-4eb4-84d1-9300f18b881a service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:03:37 user nova-compute[75469]: WARNING nova.compute.manager [req-872dbdf9-336e-4836-a508-19fa2e6e47cf req-2ecfa955-6c21-4eb4-84d1-9300f18b881a service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received unexpected event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with vm_state building and task_state spawning.
Nov 14 05:03:37 user nova-compute[75469]: INFO nova.compute.manager [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Took 17.14 seconds to build instance.
Nov 14 05:03:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-283da4ba-0b01-43cd-b348-dca03425f4a9 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "c07c6b3f-e748-4a36-a018-2336000b716d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.242s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:03:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:03:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:03:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:03:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:03:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updating instance_info_cache with network_info: [{"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:03:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-ff1ee641-8abc-4e0e-acfe-b48859a428da" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:03:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:03:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:03:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "e052c963-4a09-4997-9689-94321a3d8af8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "e052c963-4a09-4997-9689-94321a3d8af8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "e052c963-4a09-4997-9689-94321a3d8af8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "e052c963-4a09-4997-9689-94321a3d8af8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "e052c963-4a09-4997-9689-94321a3d8af8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:54 user nova-compute[75469]: INFO nova.compute.manager [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Terminating instance
Nov 14 05:03:54 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-183972ab-cc11-4e0b-936b-afc6707d8f4a req-0af3c207-bae3-40b9-895d-33ffdcb732fd service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Received event network-vif-unplugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-183972ab-cc11-4e0b-936b-afc6707d8f4a req-0af3c207-bae3-40b9-895d-33ffdcb732fd service nova] Acquiring lock "e052c963-4a09-4997-9689-94321a3d8af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-183972ab-cc11-4e0b-936b-afc6707d8f4a req-0af3c207-bae3-40b9-895d-33ffdcb732fd service nova] Lock "e052c963-4a09-4997-9689-94321a3d8af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-183972ab-cc11-4e0b-936b-afc6707d8f4a req-0af3c207-bae3-40b9-895d-33ffdcb732fd service nova] Lock "e052c963-4a09-4997-9689-94321a3d8af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-183972ab-cc11-4e0b-936b-afc6707d8f4a req-0af3c207-bae3-40b9-895d-33ffdcb732fd service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] No waiting events found dispatching network-vif-unplugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-183972ab-cc11-4e0b-936b-afc6707d8f4a req-0af3c207-bae3-40b9-895d-33ffdcb732fd service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Received event network-vif-unplugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Instance destroyed successfully.
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lazy-loading 'resources' on Instance uuid e052c963-4a09-4997-9689-94321a3d8af8 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-614520710',display_name='tempest-VolumesActionsTest-instance-614520710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-614520710',id=26,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:02:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19aa56a2b2e47648008b954f443ad0d',ramdisk_id='',reservation_id='r-azbgreo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-895657134',owner_user_name='tempest-VolumesActionsTest-895657134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:02:11Z,user_data=None,user_id='95352b2aadd047fc906642a759713a85',uuid=e052c963-4a09-4997-9689-94321a3d8af8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "address": "fa:16:3e:60:36:7c", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b04ecff-25", "ovs_interfaceid": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converting VIF {"id": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "address": "fa:16:3e:60:36:7c", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b04ecff-25", "ovs_interfaceid": "0b04ecff-25cb-4125-a82b-c245e6dcae27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=0b04ecff-25cb-4125-a82b-c245e6dcae27,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b04ecff-25') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG os_vif [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=0b04ecff-25cb-4125-a82b-c245e6dcae27,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b04ecff-25') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b04ecff-25, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad17ff29-1b58-45aa-95fa-0773ca6e395c) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:55 user nova-compute[75469]: INFO os_vif [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=0b04ecff-25cb-4125-a82b-c245e6dcae27,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b04ecff-25')
Nov 14 05:03:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Deleting instance files /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8_del
Nov 14 05:03:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Deletion of /opt/stack/data/nova/instances/e052c963-4a09-4997-9689-94321a3d8af8_del complete
Nov 14 05:03:55 user nova-compute[75469]: INFO nova.compute.manager [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: e052c963-4a09-4997-9689-94321a3d8af8] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-a1589d83-5346-48a5-ac55-a890f51aa17b req-dc6f9c5f-6a81-4fa0-91b9-6daaafb22d3b service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Received event network-vif-deleted-0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:55 user nova-compute[75469]: INFO nova.compute.manager [req-a1589d83-5346-48a5-ac55-a890f51aa17b req-dc6f9c5f-6a81-4fa0-91b9-6daaafb22d3b service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Neutron deleted interface 0b04ecff-25cb-4125-a82b-c245e6dcae27; detaching it from the instance and deleting it from the info cache
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.network.neutron [req-a1589d83-5346-48a5-ac55-a890f51aa17b req-dc6f9c5f-6a81-4fa0-91b9-6daaafb22d3b service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:03:55 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Took 0.52 seconds to deallocate network for instance.
Nov 14 05:03:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-a1589d83-5346-48a5-ac55-a890f51aa17b req-dc6f9c5f-6a81-4fa0-91b9-6daaafb22d3b service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Detach interface failed, port_id=0b04ecff-25cb-4125-a82b-c245e6dcae27, reason: Instance e052c963-4a09-4997-9689-94321a3d8af8 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:03:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:03:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7290MB free_disk=24.780986785888672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.736s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.257s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.manager [req-cf441261-a636-4f04-a797-7fb48286f7ef req-081dd612-ffa9-4e6a-bdce-abd5fe2f2d85 service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Received event network-vif-plugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cf441261-a636-4f04-a797-7fb48286f7ef req-081dd612-ffa9-4e6a-bdce-abd5fe2f2d85 service nova] Acquiring lock "e052c963-4a09-4997-9689-94321a3d8af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cf441261-a636-4f04-a797-7fb48286f7ef req-081dd612-ffa9-4e6a-bdce-abd5fe2f2d85 service nova] Lock "e052c963-4a09-4997-9689-94321a3d8af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cf441261-a636-4f04-a797-7fb48286f7ef req-081dd612-ffa9-4e6a-bdce-abd5fe2f2d85 service nova] Lock "e052c963-4a09-4997-9689-94321a3d8af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.manager [req-cf441261-a636-4f04-a797-7fb48286f7ef req-081dd612-ffa9-4e6a-bdce-abd5fe2f2d85 service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] No waiting events found dispatching network-vif-plugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:03:56 user nova-compute[75469]: WARNING nova.compute.manager [req-cf441261-a636-4f04-a797-7fb48286f7ef req-081dd612-ffa9-4e6a-bdce-abd5fe2f2d85 service nova] [instance: e052c963-4a09-4997-9689-94321a3d8af8] Received unexpected event network-vif-plugged-0b04ecff-25cb-4125-a82b-c245e6dcae27 for instance with vm_state deleted and task_state None.
Nov 14 05:03:56 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Deleted allocations for instance e052c963-4a09-4997-9689-94321a3d8af8
Nov 14 05:03:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8de9c22-99e5-488d-990b-1e0f71e0a9be tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "e052c963-4a09-4997-9689-94321a3d8af8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c0ca77d2-8353-4dfc-beed-ac479535b5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a48d1c5d-db49-4609-9ca4-21f4578d8943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4d0f0f5d-0fd7-4ef1-8431-e010764112ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a8350c59-92c2-4348-bea4-482079ec0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance ff1ee641-8abc-4e0e-acfe-b48859a428da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance bedf3e65-8970-47a2-9a96-d8fcc14016e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c07c6b3f-e748-4a36-a018-2336000b716d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:03:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:03:57 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:03:57 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:03:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:03:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:03:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:03:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:03:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:03:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:03:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:03:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:03:58 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:59 user nova-compute[75469]: INFO nova.compute.manager [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Terminating instance
Nov 14 05:03:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-2f67a060-9294-4773-b1a0-7bfe5cd29e84 req-4bf3c7bf-9bfe-49ff-a74e-e0170445a820 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Received event network-vif-unplugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f67a060-9294-4773-b1a0-7bfe5cd29e84 req-4bf3c7bf-9bfe-49ff-a74e-e0170445a820 service nova] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f67a060-9294-4773-b1a0-7bfe5cd29e84 req-4bf3c7bf-9bfe-49ff-a74e-e0170445a820 service nova] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f67a060-9294-4773-b1a0-7bfe5cd29e84 req-4bf3c7bf-9bfe-49ff-a74e-e0170445a820 service nova] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-2f67a060-9294-4773-b1a0-7bfe5cd29e84 req-4bf3c7bf-9bfe-49ff-a74e-e0170445a820 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] No waiting events found dispatching network-vif-unplugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:03:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-2f67a060-9294-4773-b1a0-7bfe5cd29e84 req-4bf3c7bf-9bfe-49ff-a74e-e0170445a820 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Received event network-vif-unplugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:00 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Instance destroyed successfully.
Nov 14 05:04:00 user nova-compute[75469]: DEBUG nova.objects.instance [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lazy-loading 'resources' on Instance uuid 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-317306228',display_name='tempest-TestServerVolumeAttachmentScenario-server-317306228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-317306228',id=24,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhUljgWB+VdbetBo1PVwMWeK9zZRUd4aDHcBeaFxt0V63YccOwb9AnUNU8ffW0wHyV+MowIvsjiRKp6sBvucsOYS2EPzMkHU8/p/yDLxLIpIttfK/9KzTi83elX1ZOjzQ==',key_name='tempest-keypair-828966378',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bad90788eab8447f81cc0d61de06bf1c',ramdisk_id='',reservation_id='r-ywu9q0cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2145462310',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2145462310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e4d3841e8f442b481b37158345b70fd',uuid=33c70f0a-fac9-4eda-96a4-c3bf693a9f7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "address": "fa:16:3e:35:aa:fe", "network": {"id": "7d797163-143e-46be-a28c-b80b41197936", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2041146029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad90788eab8447f81cc0d61de06bf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae34f9c-ed", "ovs_interfaceid": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Converting VIF {"id": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "address": "fa:16:3e:35:aa:fe", "network": {"id": "7d797163-143e-46be-a28c-b80b41197936", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2041146029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad90788eab8447f81cc0d61de06bf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae34f9c-ed", "ovs_interfaceid": "8ae34f9c-edaa-41e5-a2f8-2da19cd476fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:aa:fe,bridge_name='br-int',has_traffic_filtering=True,id=8ae34f9c-edaa-41e5-a2f8-2da19cd476fc,network=Network(7d797163-143e-46be-a28c-b80b41197936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae34f9c-ed') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG os_vif [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:aa:fe,bridge_name='br-int',has_traffic_filtering=True,id=8ae34f9c-edaa-41e5-a2f8-2da19cd476fc,network=Network(7d797163-143e-46be-a28c-b80b41197936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae34f9c-ed') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ae34f9c-ed, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=943c418b-65a0-4589-ac81-1fc1aeaa714c) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:00 user nova-compute[75469]: INFO os_vif [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:aa:fe,bridge_name='br-int',has_traffic_filtering=True,id=8ae34f9c-edaa-41e5-a2f8-2da19cd476fc,network=Network(7d797163-143e-46be-a28c-b80b41197936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae34f9c-ed')
Nov 14 05:04:00 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Deleting instance files /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f_del
Nov 14 05:04:00 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Deletion of /opt/stack/data/nova/instances/33c70f0a-fac9-4eda-96a4-c3bf693a9f7f_del complete
Nov 14 05:04:00 user nova-compute[75469]: INFO nova.compute.manager [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 05:04:00 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:04:00 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:04:01 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Took 0.64 seconds to deallocate network for instance.
Nov 14 05:04:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-d52e2444-56ae-4854-b0a1-150982aa367c req-9246a235-ddb9-4ac0-ad0e-1d4a6ba60c49 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Received event network-vif-deleted-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:01 user nova-compute[75469]: INFO nova.compute.manager [req-d52e2444-56ae-4854-b0a1-150982aa367c req-9246a235-ddb9-4ac0-ad0e-1d4a6ba60c49 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Neutron deleted interface 8ae34f9c-edaa-41e5-a2f8-2da19cd476fc; detaching it from the instance and deleting it from the info cache
Nov 14 05:04:01 user nova-compute[75469]: DEBUG nova.network.neutron [req-d52e2444-56ae-4854-b0a1-150982aa367c req-9246a235-ddb9-4ac0-ad0e-1d4a6ba60c49 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG nova.compute.manager [req-d52e2444-56ae-4854-b0a1-150982aa367c req-9246a235-ddb9-4ac0-ad0e-1d4a6ba60c49 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Detach interface failed, port_id=8ae34f9c-edaa-41e5-a2f8-2da19cd476fc, reason: Instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:01 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Deleted allocations for instance 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f
Nov 14 05:04:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0690864e-8a38-4294-a632-219402b32554 tempest-TestServerVolumeAttachmentScenario-2145462310 tempest-TestServerVolumeAttachmentScenario-2145462310-project-member] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.061s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:01 user nova-compute[75469]: INFO nova.compute.manager [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Terminating instance
Nov 14 05:04:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-75d15d69-12f5-46bf-ae2e-7d3c663ce6ef req-cf9961a3-ffb1-423b-a89d-2f7e5a46f017 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Received event network-vif-plugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-75d15d69-12f5-46bf-ae2e-7d3c663ce6ef req-cf9961a3-ffb1-423b-a89d-2f7e5a46f017 service nova] Acquiring lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-75d15d69-12f5-46bf-ae2e-7d3c663ce6ef req-cf9961a3-ffb1-423b-a89d-2f7e5a46f017 service nova] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-75d15d69-12f5-46bf-ae2e-7d3c663ce6ef req-cf9961a3-ffb1-423b-a89d-2f7e5a46f017 service nova] Lock "33c70f0a-fac9-4eda-96a4-c3bf693a9f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-75d15d69-12f5-46bf-ae2e-7d3c663ce6ef req-cf9961a3-ffb1-423b-a89d-2f7e5a46f017 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] No waiting events found dispatching network-vif-plugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:04:02 user nova-compute[75469]: WARNING nova.compute.manager [req-75d15d69-12f5-46bf-ae2e-7d3c663ce6ef req-cf9961a3-ffb1-423b-a89d-2f7e5a46f017 service nova] [instance: 33c70f0a-fac9-4eda-96a4-c3bf693a9f7f] Received unexpected event network-vif-plugged-8ae34f9c-edaa-41e5-a2f8-2da19cd476fc for instance with vm_state deleted and task_state None.
Nov 14 05:04:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-4d68e47f-84b8-465a-958a-df29b96e0a95 req-27f7111a-b2fb-4602-ba4d-272e0df7deea service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-unplugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4d68e47f-84b8-465a-958a-df29b96e0a95 req-27f7111a-b2fb-4602-ba4d-272e0df7deea service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4d68e47f-84b8-465a-958a-df29b96e0a95 req-27f7111a-b2fb-4602-ba4d-272e0df7deea service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4d68e47f-84b8-465a-958a-df29b96e0a95 req-27f7111a-b2fb-4602-ba4d-272e0df7deea service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-4d68e47f-84b8-465a-958a-df29b96e0a95 req-27f7111a-b2fb-4602-ba4d-272e0df7deea service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-unplugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-4d68e47f-84b8-465a-958a-df29b96e0a95 req-27f7111a-b2fb-4602-ba4d-272e0df7deea service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-unplugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:04:02 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Instance destroyed successfully.
Nov 14 05:04:02 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lazy-loading 'resources' on Instance uuid c0ca77d2-8353-4dfc-beed-ac479535b5ba {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-507385695',display_name='tempest-ServerStableDeviceRescueTest-server-507385695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-507385695',id=18,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1+oqJ9P3bJ6y3y5C3t27tL4Ym2PLlY6l+cjQK9mE7PE9A+RlQ7Gt4TEObvMcrKFh4CuugLIwEsNKlc182b2KNQ2YftDJe4jK9zJ+va2E7K+EFaHyRoGOtaoVfEeS4fzA==',key_name='tempest-keypair-1578813028',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:00:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a019d303cd8c4aaca04142c29797192f',ramdisk_id='',reservation_id='r-q4c5sspw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-40224201',owner_user_name='tempest-ServerStableDeviceRescueTest-40224201-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:02:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5082710327f40249242020afcfe1b62',uuid=c0ca77d2-8353-4dfc-beed-ac479535b5ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Converting VIF {"id": "bf280bdb-b07e-4472-b87a-304b48127d7c", "address": "fa:16:3e:a1:ee:ec", "network": {"id": "2d30057a-3bb9-4010-befa-3f57b496f45a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-580878810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a019d303cd8c4aaca04142c29797192f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf280bdb-b0", "ovs_interfaceid": "bf280bdb-b07e-4472-b87a-304b48127d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ee:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf280bdb-b07e-4472-b87a-304b48127d7c,network=Network(2d30057a-3bb9-4010-befa-3f57b496f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf280bdb-b0') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG os_vif [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ee:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf280bdb-b07e-4472-b87a-304b48127d7c,network=Network(2d30057a-3bb9-4010-befa-3f57b496f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf280bdb-b0') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf280bdb-b0, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a5f68b4-e0c4-42a4-8304-9239ca6f8855) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:02 user nova-compute[75469]: INFO os_vif [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ee:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf280bdb-b07e-4472-b87a-304b48127d7c,network=Network(2d30057a-3bb9-4010-befa-3f57b496f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf280bdb-b0')
Nov 14 05:04:02 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Deleting instance files /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba_del
Nov 14 05:04:02 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Deletion of /opt/stack/data/nova/instances/c0ca77d2-8353-4dfc-beed-ac479535b5ba_del complete
Nov 14 05:04:02 user nova-compute[75469]: INFO nova.compute.manager [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 05:04:02 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:04:02 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:04:03 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:04:03 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Took 1.29 seconds to deallocate network for instance.
Nov 14 05:04:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-f80f8561-9d9e-4fce-ad91-a411939278e5 req-868ab871-3019-494c-9ee0-096616bed438 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-deleted-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-3e41dc82-3b8f-4193-a04d-995f8f4ddbf3 req-2e923498-4ecf-40a0-a143-5de9c26f7cf3 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3e41dc82-3b8f-4193-a04d-995f8f4ddbf3 req-2e923498-4ecf-40a0-a143-5de9c26f7cf3 service nova] Acquiring lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3e41dc82-3b8f-4193-a04d-995f8f4ddbf3 req-2e923498-4ecf-40a0-a143-5de9c26f7cf3 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3e41dc82-3b8f-4193-a04d-995f8f4ddbf3 req-2e923498-4ecf-40a0-a143-5de9c26f7cf3 service nova] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-3e41dc82-3b8f-4193-a04d-995f8f4ddbf3 req-2e923498-4ecf-40a0-a143-5de9c26f7cf3 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] No waiting events found dispatching network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:04:04 user nova-compute[75469]: WARNING nova.compute.manager [req-3e41dc82-3b8f-4193-a04d-995f8f4ddbf3 req-2e923498-4ecf-40a0-a143-5de9c26f7cf3 service nova] [instance: c0ca77d2-8353-4dfc-beed-ac479535b5ba] Received unexpected event network-vif-plugged-bf280bdb-b07e-4472-b87a-304b48127d7c for instance with vm_state deleted and task_state None.
Nov 14 05:04:04 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:04:04 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:04:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:04 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Deleted allocations for instance c0ca77d2-8353-4dfc-beed-ac479535b5ba
Nov 14 05:04:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4accaea5-4eff-45a7-a658-942e25130c06 tempest-ServerStableDeviceRescueTest-40224201 tempest-ServerStableDeviceRescueTest-40224201-project-member] Lock "c0ca77d2-8353-4dfc-beed-ac479535b5ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.625s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-1ea2dc3c-eec6-4718-b714-82d50b7e5a28 req-62af7fba-2fe7-48ff-8367-7deec6729608 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received event network-changed-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-1ea2dc3c-eec6-4718-b714-82d50b7e5a28 req-62af7fba-2fe7-48ff-8367-7deec6729608 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Refreshing instance network info cache due to event network-changed-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:04:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1ea2dc3c-eec6-4718-b714-82d50b7e5a28 req-62af7fba-2fe7-48ff-8367-7deec6729608 service nova] Acquiring lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:04:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1ea2dc3c-eec6-4718-b714-82d50b7e5a28 req-62af7fba-2fe7-48ff-8367-7deec6729608 service nova] Acquired lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:04:18 user nova-compute[75469]: DEBUG nova.network.neutron [req-1ea2dc3c-eec6-4718-b714-82d50b7e5a28 req-62af7fba-2fe7-48ff-8367-7deec6729608 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Refreshing network info cache for port e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:04:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-1ea2dc3c-eec6-4718-b714-82d50b7e5a28 req-62af7fba-2fe7-48ff-8367-7deec6729608 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updated VIF entry in instance network info cache for port e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:04:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-1ea2dc3c-eec6-4718-b714-82d50b7e5a28 req-62af7fba-2fe7-48ff-8367-7deec6729608 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updating instance_info_cache with network_info: [{"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:04:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1ea2dc3c-eec6-4718-b714-82d50b7e5a28 req-62af7fba-2fe7-48ff-8367-7deec6729608 service nova] Releasing lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:04:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-3231becc-42b0-4d5b-8378-cb1b0e70ff18 req-459356df-c298-4804-b5ff-ae3f9f7ac16a service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Received event network-changed-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-3231becc-42b0-4d5b-8378-cb1b0e70ff18 req-459356df-c298-4804-b5ff-ae3f9f7ac16a service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Refreshing instance network info cache due to event network-changed-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:04:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3231becc-42b0-4d5b-8378-cb1b0e70ff18 req-459356df-c298-4804-b5ff-ae3f9f7ac16a service nova] Acquiring lock "refresh_cache-4d0f0f5d-0fd7-4ef1-8431-e010764112ee" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:04:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3231becc-42b0-4d5b-8378-cb1b0e70ff18 req-459356df-c298-4804-b5ff-ae3f9f7ac16a service nova] Acquired lock "refresh_cache-4d0f0f5d-0fd7-4ef1-8431-e010764112ee" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:04:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-3231becc-42b0-4d5b-8378-cb1b0e70ff18 req-459356df-c298-4804-b5ff-ae3f9f7ac16a service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Refreshing network info cache for port b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:04:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-3231becc-42b0-4d5b-8378-cb1b0e70ff18 req-459356df-c298-4804-b5ff-ae3f9f7ac16a service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Updated VIF entry in instance network info cache for port b09ee5b7-60ed-43d1-8a22-55f4e1dedf59. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:04:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-3231becc-42b0-4d5b-8378-cb1b0e70ff18 req-459356df-c298-4804-b5ff-ae3f9f7ac16a service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Updating instance_info_cache with network_info: [{"id": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "address": "fa:16:3e:f9:f5:91", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09ee5b7-60", "ovs_interfaceid": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:04:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3231becc-42b0-4d5b-8378-cb1b0e70ff18 req-459356df-c298-4804-b5ff-ae3f9f7ac16a service nova] Releasing lock "refresh_cache-4d0f0f5d-0fd7-4ef1-8431-e010764112ee" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:04:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:24 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'flavor' on Instance uuid 4d0f0f5d-0fd7-4ef1-8431-e010764112ee {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:04:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:25 user nova-compute[75469]: INFO nova.compute.manager [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Attaching volume d776ced6-2a95-426c-aa78-0f134a525b57 to /dev/vdb
Nov 14 05:04:25 user nova-compute[75469]: DEBUG os_brick.utils [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f17b24-2c5a-421d-a079-d85caba99356]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d17164-c44b-4dbc-a551-f35e77b87f19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe79385-2172-49bc-8879-95c0d70f3db0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c25dc5-cc4a-44f0-a35c-e927de4e1746]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:04:25 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:04:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b21aad-66ae-4e30-a639-58f1cdaef320]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG os_brick.utils [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:04:25 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Updating existing volume attachment record: ac239081-2156-41d3-b3a5-d7a31cf00d24 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:04:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-c78221cf-f957-4b17-be81-a860c8323ad6 req-4116cdda-e23e-4db2-aebc-33129ca4efc0 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Received event network-changed-472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-c78221cf-f957-4b17-be81-a860c8323ad6 req-4116cdda-e23e-4db2-aebc-33129ca4efc0 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Refreshing instance network info cache due to event network-changed-472a1743-c919-4b69-aa32-7cebc40c439e. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:04:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c78221cf-f957-4b17-be81-a860c8323ad6 req-4116cdda-e23e-4db2-aebc-33129ca4efc0 service nova] Acquiring lock "refresh_cache-a8350c59-92c2-4348-bea4-482079ec0f5a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:04:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c78221cf-f957-4b17-be81-a860c8323ad6 req-4116cdda-e23e-4db2-aebc-33129ca4efc0 service nova] Acquired lock "refresh_cache-a8350c59-92c2-4348-bea4-482079ec0f5a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:04:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-c78221cf-f957-4b17-be81-a860c8323ad6 req-4116cdda-e23e-4db2-aebc-33129ca4efc0 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Refreshing network info cache for port 472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:04:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-c78221cf-f957-4b17-be81-a860c8323ad6 req-4116cdda-e23e-4db2-aebc-33129ca4efc0 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Updated VIF entry in instance network info cache for port 472a1743-c919-4b69-aa32-7cebc40c439e. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:04:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-c78221cf-f957-4b17-be81-a860c8323ad6 req-4116cdda-e23e-4db2-aebc-33129ca4efc0 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Updating instance_info_cache with network_info: [{"id": "472a1743-c919-4b69-aa32-7cebc40c439e", "address": "fa:16:3e:b4:92:5f", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472a1743-c9", "ovs_interfaceid": "472a1743-c919-4b69-aa32-7cebc40c439e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:04:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c78221cf-f957-4b17-be81-a860c8323ad6 req-4116cdda-e23e-4db2-aebc-33129ca4efc0 service nova] Releasing lock "refresh_cache-a8350c59-92c2-4348-bea4-482079ec0f5a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:04:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG nova.objects.instance [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid a8350c59-92c2-4348-bea4-482079ec0f5a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:28 user nova-compute[75469]: INFO nova.compute.manager [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Attaching volume 7572d61f-a232-4a22-842e-c18658a70c8c to /dev/vdb
Nov 14 05:04:28 user nova-compute[75469]: DEBUG os_brick.utils [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[83827d2c-ba13-40a1-b8b6-5e70ceaa2fde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d56fe7-217e-4dee-b0bf-471cc4fcf6e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84e7c05-32b0-432a-a056-37ede5af4d4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c704897-323d-49b0-b681-f11d18ed0157]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:04:28 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:04:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[efab6576-bbfe-4eac-9d26-7abdfb6cde0b]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG os_brick.utils [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:04:28 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Updating existing volume attachment record: bf72d362-89f9-4bf5-9ab1-d76ba5abbdc0 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFmZNcTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:04:29 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:04:29 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:04:29 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b563f039-3756-4512-9327-1207d9bfb2f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:04:29 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[902c2f8e-719f-450f-9967-2320c7ebb440]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57] added
Nov 14 05:04:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a28881-4d8d-4137-a9df-ef7bde9fc1c2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14bdaba-e458-4c66-8837-7ec383dfd72f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFmZNcTB {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFmZNcTB" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe5846c-0ec1-455e-bec7-bb9383525fd8]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IFmZNcTB'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc3ef90-66d0-4929-8270-ee9cd568c477]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f806947-2272-4776-8aa8-4879561ddf3e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:29 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:29 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:29 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:29 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfbc263-49f7-4b2e-bc12-f6e35d2f5ae1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57, portal: 172.16.0.220,3260]
Nov 14 05:04:29 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57, portal: 172.16.0.220,3260] successful.
Nov 14 05:04:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dc1050-42ab-4218-8dab-b175bb082093]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[772fb0e6-ac47-4daa-ab65-fae0a93e5626]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:29 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:29 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:29 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:29 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:29 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:29 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ba7e42-b293-4062-821f-0cfd2e4fe66f]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:29 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:04:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:04:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFmZNcTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:04:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:04:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23530376663363661', 'path': '/dev/sde'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:04:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530376663363661', 'path': '/dev/sde'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:04:30 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'flavor' on Instance uuid 4d0f0f5d-0fd7-4ef1-8431-e010764112ee {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:04:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:04:30 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:04:30 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:04:30 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:04:30 user nova-compute[75469]:   <serial>d776ced6-2a95-426c-aa78-0f134a525b57</serial>
Nov 14 05:04:30 user nova-compute[75469]: </disk>
Nov 14 05:04:30 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:04:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:04:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:04:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No VIF found with MAC fa:16:3e:f9:f5:91, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:04:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3e7b8e09-d8ea-49af-856f-42dee7b8081f tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.318s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:31 user nova-compute[75469]: INFO nova.compute.manager [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Detaching volume d776ced6-2a95-426c-aa78-0f134a525b57
Nov 14 05:04:31 user nova-compute[75469]: INFO nova.virt.block_device [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Attempting to driver detach volume d776ced6-2a95-426c-aa78-0f134a525b57 from mountpoint /dev/vdb
Nov 14 05:04:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Attempting to detach device vdb from instance 4d0f0f5d-0fd7-4ef1-8431-e010764112ee from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:04:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:04:31 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:04:31 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:04:31 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:04:31 user nova-compute[75469]:   <serial>d776ced6-2a95-426c-aa78-0f134a525b57</serial>
Nov 14 05:04:31 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:04:31 user nova-compute[75469]: </disk>
Nov 14 05:04:31 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:04:31 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully detached device vdb from instance 4d0f0f5d-0fd7-4ef1-8431-e010764112ee from the persistent domain config.
Nov 14 05:04:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4d0f0f5d-0fd7-4ef1-8431-e010764112ee from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:04:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:04:31 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:04:31 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:04:31 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:04:31 user nova-compute[75469]:   <serial>d776ced6-2a95-426c-aa78-0f134a525b57</serial>
Nov 14 05:04:31 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:04:31 user nova-compute[75469]: </disk>
Nov 14 05:04:31 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4d0f0f5d-0fd7-4ef1-8431-e010764112ee {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lipMRIUd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:04:32 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:04:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:04:32 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:04:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:04:32 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:04:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb811f2-3763-4813-b95a-3c5116288602]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:04:32 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[564ef139-276e-4550-b3e9-db2a7e6c2d4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c] added
Nov 14 05:04:32 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f028af-b21e-4c59-8a29-fb46f253ca64]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5296832a-fc69-4683-97d0-d75773e68a5e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lipMRIUd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lipMRIUd" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4aaaa5-cbbc-41e2-8fb1-d6b745941279]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lipMRIUd'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[23387ac2-dde9-41a7-86b5-9b99c4504020]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[024934a3-3eee-4c0b-98d1-689359b323ea]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b429e436-9016-411d-baf1-920b1ad0f1d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c, portal: 172.16.0.220,3260]
Nov 14 05:04:33 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c, portal: 172.16.0.220,3260] successful.
Nov 14 05:04:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1af3a3-f0a6-4821-aa27-968ba567c156]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eca498-f1ac-4ca8-906a-f4c76a19bbf9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)
Nov 14 05:04:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:33 user nova-compute[75469]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)
Nov 14 05:04:33 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4deb11a-8874-467a-986c-e4a48f9f23ce]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:04:33 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lipMRIUd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:04:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:04:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26364366165303835', 'path': '/dev/sdf'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:04:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364366165303835', 'path': '/dev/sdf'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:04:34 user nova-compute[75469]: DEBUG nova.objects.instance [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid a8350c59-92c2-4348-bea4-482079ec0f5a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:04:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:04:34 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:04:34 user nova-compute[75469]:   <source dev="/dev/sdf"/>
Nov 14 05:04:34 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:04:34 user nova-compute[75469]:   <serial>7572d61f-a232-4a22-842e-c18658a70c8c</serial>
Nov 14 05:04:34 user nova-compute[75469]: </disk>
Nov 14 05:04:34 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:04:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:04:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:04:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No VIF found with MAC fa:16:3e:b4:92:5f, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:04:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-96457e4a-4b33-4866-ad81-00dc19603f33 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.395s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG nova.objects.instance [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid a8350c59-92c2-4348-bea4-482079ec0f5a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:36 user nova-compute[75469]: INFO nova.compute.manager [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Attaching volume a2baab7f-5cfb-413b-9006-1ac2f592ef0b to /dev/vdc
Nov 14 05:04:36 user nova-compute[75469]: DEBUG os_brick.utils [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae066fb0-37b7-445d-8461-304344d36ac8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e67f2e-9bc9-439b-942d-c804e83198a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04e996-b206-4cd2-b25a-5829f0539e79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a199393f-cdd8-4b38-815f-4cc0de98d49b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:04:36 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:04:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc567e3-97f7-4e73-a52e-c1b13c72e55d]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG os_brick.utils [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:04:36 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Updating existing volume attachment record: 9035fa4a-5ecb-4c2a-a942-16ef3444c288 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:04:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'axHUtyBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:04:40 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:04:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:04:40 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:04:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:04:40 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:04:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b992fe-fc83-40fe-b5a2-42143334a2d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:04:40 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[356f3d8b-2b02-40d1-b8e3-8ddd889de512]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b] added
Nov 14 05:04:40 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[416a97e0-d19e-45eb-b84f-3b5ea0eed3de]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40837ff-bb13-40d4-8df4-938914b7de52]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v axHUtyBw {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v axHUtyBw" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7b6e30-1080-4390-a72b-21838e19e8c3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'axHUtyBw'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f6fc7b-f4ab-41b1-b7e8-1af2b4f9c4e1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fde2fc-7e0c-4fe1-b614-3f42335a65f6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)
Nov 14 05:04:41 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)
Nov 14 05:04:41 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6d9297-0442-4081-a5f7-fcc431de008e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b, portal: 172.16.0.220,3260]
Nov 14 05:04:41 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b, portal: 172.16.0.220,3260] successful.
Nov 14 05:04:41 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e0d034-aa6c-47f1-bc1c-4766dab926b6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[de26bdbc-0c80-4bf2-b4e2-a2526a4deff5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:04:41 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)
Nov 14 05:04:41 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:04:41 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94701858-f79c-4a03-8987-d1cea5b09917]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:04:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'axHUtyBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23964393264396439', 'path': '/dev/sdg'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964393264396439', 'path': '/dev/sdg'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG nova.objects.instance [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid a8350c59-92c2-4348-bea4-482079ec0f5a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:04:42 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:04:42 user nova-compute[75469]:   <source dev="/dev/sdg"/>
Nov 14 05:04:42 user nova-compute[75469]:   <target dev="vdc" bus="virtio"/>
Nov 14 05:04:42 user nova-compute[75469]:   <serial>a2baab7f-5cfb-413b-9006-1ac2f592ef0b</serial>
Nov 14 05:04:42 user nova-compute[75469]: </disk>
Nov 14 05:04:42 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] No VIF found with MAC fa:16:3e:b4:92:5f, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:04:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-33a835af-4a7f-4245-b980-3f46c0d4b1c0 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.304s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:43 user nova-compute[75469]: INFO nova.compute.manager [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Detaching volume 7572d61f-a232-4a22-842e-c18658a70c8c
Nov 14 05:04:43 user nova-compute[75469]: INFO nova.virt.block_device [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Attempting to driver detach volume 7572d61f-a232-4a22-842e-c18658a70c8c from mountpoint /dev/vdb
Nov 14 05:04:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Attempting to detach device vdb from instance a8350c59-92c2-4348-bea4-482079ec0f5a from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:04:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:04:43 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:04:43 user nova-compute[75469]:   <source dev="/dev/sdf"/>
Nov 14 05:04:43 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:04:43 user nova-compute[75469]:   <serial>7572d61f-a232-4a22-842e-c18658a70c8c</serial>
Nov 14 05:04:43 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:04:43 user nova-compute[75469]: </disk>
Nov 14 05:04:43 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:04:43 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully detached device vdb from instance a8350c59-92c2-4348-bea4-482079ec0f5a from the persistent domain config.
Nov 14 05:04:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8350c59-92c2-4348-bea4-482079ec0f5a from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:04:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:04:43 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:04:43 user nova-compute[75469]:   <source dev="/dev/sdf"/>
Nov 14 05:04:43 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:04:43 user nova-compute[75469]:   <serial>7572d61f-a232-4a22-842e-c18658a70c8c</serial>
Nov 14 05:04:43 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:04:43 user nova-compute[75469]: </disk>
Nov 14 05:04:43 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:04:43 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8350c59-92c2-4348-bea4-482079ec0f5a {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:04:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "c8335ffd-314e-43f1-9573-200556415a14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "c8335ffd-314e-43f1-9573-200556415a14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:04:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:45 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:04:45 user nova-compute[75469]: INFO nova.compute.claims [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Claim successful on node user
Nov 14 05:04:46 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:04:46 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:04:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG nova.policy [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95352b2aadd047fc906642a759713a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19aa56a2b2e47648008b954f443ad0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:04:46 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Creating image(s)
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "/opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "/opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.199s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.192s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk 1073741824" returned: 0 in 0.056s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Successfully created port: 8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.194s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Cannot resize image /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Ensure instance console log exists: /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Successfully updated port: 8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "refresh_cache-c8335ffd-314e-43f1-9573-200556415a14" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquired lock "refresh_cache-c8335ffd-314e-43f1-9573-200556415a14" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-f1222068-7ecc-45e1-8c9c-aaf32f43c79b req-6dcc42db-af5d-4546-b107-fe91ffb11ce5 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Received event network-changed-8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-f1222068-7ecc-45e1-8c9c-aaf32f43c79b req-6dcc42db-af5d-4546-b107-fe91ffb11ce5 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Refreshing instance network info cache due to event network-changed-8367797e-d56a-42f1-a00c-87bbe5c43253. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f1222068-7ecc-45e1-8c9c-aaf32f43c79b req-6dcc42db-af5d-4546-b107-fe91ffb11ce5 service nova] Acquiring lock "refresh_cache-c8335ffd-314e-43f1-9573-200556415a14" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:04:47 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Updating instance_info_cache with network_info: [{"id": "8367797e-d56a-42f1-a00c-87bbe5c43253", "address": "fa:16:3e:d3:87:ea", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8367797e-d5", "ovs_interfaceid": "8367797e-d56a-42f1-a00c-87bbe5c43253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Releasing lock "refresh_cache-c8335ffd-314e-43f1-9573-200556415a14" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Instance network_info: |[{"id": "8367797e-d56a-42f1-a00c-87bbe5c43253", "address": "fa:16:3e:d3:87:ea", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8367797e-d5", "ovs_interfaceid": "8367797e-d56a-42f1-a00c-87bbe5c43253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f1222068-7ecc-45e1-8c9c-aaf32f43c79b req-6dcc42db-af5d-4546-b107-fe91ffb11ce5 service nova] Acquired lock "refresh_cache-c8335ffd-314e-43f1-9573-200556415a14" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.network.neutron [req-f1222068-7ecc-45e1-8c9c-aaf32f43c79b req-6dcc42db-af5d-4546-b107-fe91ffb11ce5 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Refreshing network info cache for port 8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Start _get_guest_xml network_info=[{"id": "8367797e-d56a-42f1-a00c-87bbe5c43253", "address": "fa:16:3e:d3:87:ea", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8367797e-d5", "ovs_interfaceid": "8367797e-d56a-42f1-a00c-87bbe5c43253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:04:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:04:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-42742565',display_name='tempest-VolumesActionsTest-instance-42742565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-42742565',id=32,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19aa56a2b2e47648008b954f443ad0d',ramdisk_id='',reservation_id='r-s071nwcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-895657134',owner_user_name='tempest-VolumesActionsTest-895657134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:04:46Z,user_data=None,user_id='95352b2aadd047fc906642a759713a85',uuid=c8335ffd-314e-43f1-9573-200556415a14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8367797e-d56a-42f1-a00c-87bbe5c43253", "address": "fa:16:3e:d3:87:ea", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8367797e-d5", "ovs_interfaceid": "8367797e-d56a-42f1-a00c-87bbe5c43253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converting VIF {"id": "8367797e-d56a-42f1-a00c-87bbe5c43253", "address": "fa:16:3e:d3:87:ea", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8367797e-d5", "ovs_interfaceid": "8367797e-d56a-42f1-a00c-87bbe5c43253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:87:ea,bridge_name='br-int',has_traffic_filtering=True,id=8367797e-d56a-42f1-a00c-87bbe5c43253,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8367797e-d5') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lazy-loading 'pci_devices' on Instance uuid c8335ffd-314e-43f1-9573-200556415a14 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:04:48 user nova-compute[75469]:   <uuid>c8335ffd-314e-43f1-9573-200556415a14</uuid>
Nov 14 05:04:48 user nova-compute[75469]:   <name>instance-00000020</name>
Nov 14 05:04:48 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:04:48 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:04:48 user nova-compute[75469]:   <metadata>
Nov 14 05:04:48 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:04:48 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:04:48 user nova-compute[75469]:       <nova:name>tempest-VolumesActionsTest-instance-42742565</nova:name>
Nov 14 05:04:48 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:04:48</nova:creationTime>
Nov 14 05:04:48 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:04:48 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:04:48 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:04:48 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:04:48 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:04:48 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:04:48 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:04:48 user nova-compute[75469]:       <nova:owner>
Nov 14 05:04:48 user nova-compute[75469]:         <nova:user uuid="95352b2aadd047fc906642a759713a85">tempest-VolumesActionsTest-895657134-project-member</nova:user>
Nov 14 05:04:48 user nova-compute[75469]:         <nova:project uuid="d19aa56a2b2e47648008b954f443ad0d">tempest-VolumesActionsTest-895657134</nova:project>
Nov 14 05:04:48 user nova-compute[75469]:       </nova:owner>
Nov 14 05:04:48 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:04:48 user nova-compute[75469]:       <nova:ports>
Nov 14 05:04:48 user nova-compute[75469]:         <nova:port uuid="8367797e-d56a-42f1-a00c-87bbe5c43253">
Nov 14 05:04:48 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 05:04:48 user nova-compute[75469]:         </nova:port>
Nov 14 05:04:48 user nova-compute[75469]:       </nova:ports>
Nov 14 05:04:48 user nova-compute[75469]:     </nova:instance>
Nov 14 05:04:48 user nova-compute[75469]:   </metadata>
Nov 14 05:04:48 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:04:48 user nova-compute[75469]:     <system>
Nov 14 05:04:48 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:04:48 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:04:48 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:04:48 user nova-compute[75469]:       <entry name="serial">c8335ffd-314e-43f1-9573-200556415a14</entry>
Nov 14 05:04:48 user nova-compute[75469]:       <entry name="uuid">c8335ffd-314e-43f1-9573-200556415a14</entry>
Nov 14 05:04:48 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:04:48 user nova-compute[75469]:     </system>
Nov 14 05:04:48 user nova-compute[75469]:   </sysinfo>
Nov 14 05:04:48 user nova-compute[75469]:   <os>
Nov 14 05:04:48 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:04:48 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:04:48 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:04:48 user nova-compute[75469]:   </os>
Nov 14 05:04:48 user nova-compute[75469]:   <features>
Nov 14 05:04:48 user nova-compute[75469]:     <acpi/>
Nov 14 05:04:48 user nova-compute[75469]:     <apic/>
Nov 14 05:04:48 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:04:48 user nova-compute[75469]:   </features>
Nov 14 05:04:48 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:04:48 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:04:48 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:04:48 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:04:48 user nova-compute[75469]:   </clock>
Nov 14 05:04:48 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:04:48 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:04:48 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:04:48 user nova-compute[75469]:   </cpu>
Nov 14 05:04:48 user nova-compute[75469]:   <devices>
Nov 14 05:04:48 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:04:48 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:04:48 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk"/>
Nov 14 05:04:48 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:04:48 user nova-compute[75469]:     </disk>
Nov 14 05:04:48 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:04:48 user nova-compute[75469]:       <mac address="fa:16:3e:d3:87:ea"/>
Nov 14 05:04:48 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:04:48 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:04:48 user nova-compute[75469]:       <target dev="tap8367797e-d5"/>
Nov 14 05:04:48 user nova-compute[75469]:     </interface>
Nov 14 05:04:48 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:04:48 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/console.log" append="off"/>
Nov 14 05:04:48 user nova-compute[75469]:     </serial>
Nov 14 05:04:48 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:04:48 user nova-compute[75469]:     <video>
Nov 14 05:04:48 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:04:48 user nova-compute[75469]:     </video>
Nov 14 05:04:48 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:04:48 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:04:48 user nova-compute[75469]:     </rng>
Nov 14 05:04:48 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:04:48 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:04:48 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:04:48 user nova-compute[75469]:     </memballoon>
Nov 14 05:04:48 user nova-compute[75469]:   </devices>
Nov 14 05:04:48 user nova-compute[75469]: </domain>
Nov 14 05:04:48 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-42742565',display_name='tempest-VolumesActionsTest-instance-42742565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-42742565',id=32,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19aa56a2b2e47648008b954f443ad0d',ramdisk_id='',reservation_id='r-s071nwcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-895657134',owner_user_name='tempest-VolumesActionsTest-895657134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:04:46Z,user_data=None,user_id='95352b2aadd047fc906642a759713a85',uuid=c8335ffd-314e-43f1-9573-200556415a14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8367797e-d56a-42f1-a00c-87bbe5c43253", "address": "fa:16:3e:d3:87:ea", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8367797e-d5", "ovs_interfaceid": "8367797e-d56a-42f1-a00c-87bbe5c43253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converting VIF {"id": "8367797e-d56a-42f1-a00c-87bbe5c43253", "address": "fa:16:3e:d3:87:ea", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8367797e-d5", "ovs_interfaceid": "8367797e-d56a-42f1-a00c-87bbe5c43253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:87:ea,bridge_name='br-int',has_traffic_filtering=True,id=8367797e-d56a-42f1-a00c-87bbe5c43253,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8367797e-d5') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG os_vif [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:87:ea,bridge_name='br-int',has_traffic_filtering=True,id=8367797e-d56a-42f1-a00c-87bbe5c43253,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8367797e-d5') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '981c9cc6-9240-5a35-9294-e0f37d2ca8e9', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8367797e-d5, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8367797e-d5, col_values=(('qos', UUID('80b9b637-35ff-4dd9-a59a-e02c6d84fcd2')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8367797e-d5, col_values=(('external_ids', {'iface-id': '8367797e-d56a-42f1-a00c-87bbe5c43253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:87:ea', 'vm-uuid': 'c8335ffd-314e-43f1-9573-200556415a14'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:48 user nova-compute[75469]: INFO os_vif [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:87:ea,bridge_name='br-int',has_traffic_filtering=True,id=8367797e-d56a-42f1-a00c-87bbe5c43253,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8367797e-d5')
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] No VIF found with MAC fa:16:3e:d3:87:ea, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.network.neutron [req-f1222068-7ecc-45e1-8c9c-aaf32f43c79b req-6dcc42db-af5d-4546-b107-fe91ffb11ce5 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Updated VIF entry in instance network info cache for port 8367797e-d56a-42f1-a00c-87bbe5c43253. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG nova.network.neutron [req-f1222068-7ecc-45e1-8c9c-aaf32f43c79b req-6dcc42db-af5d-4546-b107-fe91ffb11ce5 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Updating instance_info_cache with network_info: [{"id": "8367797e-d56a-42f1-a00c-87bbe5c43253", "address": "fa:16:3e:d3:87:ea", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8367797e-d5", "ovs_interfaceid": "8367797e-d56a-42f1-a00c-87bbe5c43253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:04:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f1222068-7ecc-45e1-8c9c-aaf32f43c79b req-6dcc42db-af5d-4546-b107-fe91ffb11ce5 service nova] Releasing lock "refresh_cache-c8335ffd-314e-43f1-9573-200556415a14" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:04:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-469c7fe8-c525-40eb-8816-e2ec38ea6218 req-3b771392-f342-4437-9def-1c67cfbb0dc2 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Received event network-vif-plugged-8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-469c7fe8-c525-40eb-8816-e2ec38ea6218 req-3b771392-f342-4437-9def-1c67cfbb0dc2 service nova] Acquiring lock "c8335ffd-314e-43f1-9573-200556415a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-469c7fe8-c525-40eb-8816-e2ec38ea6218 req-3b771392-f342-4437-9def-1c67cfbb0dc2 service nova] Lock "c8335ffd-314e-43f1-9573-200556415a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-469c7fe8-c525-40eb-8816-e2ec38ea6218 req-3b771392-f342-4437-9def-1c67cfbb0dc2 service nova] Lock "c8335ffd-314e-43f1-9573-200556415a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-469c7fe8-c525-40eb-8816-e2ec38ea6218 req-3b771392-f342-4437-9def-1c67cfbb0dc2 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] No waiting events found dispatching network-vif-plugged-8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:04:49 user nova-compute[75469]: WARNING nova.compute.manager [req-469c7fe8-c525-40eb-8816-e2ec38ea6218 req-3b771392-f342-4437-9def-1c67cfbb0dc2 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Received unexpected event network-vif-plugged-8367797e-d56a-42f1-a00c-87bbe5c43253 for instance with vm_state building and task_state spawning.
Nov 14 05:04:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:04:51 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c8335ffd-314e-43f1-9573-200556415a14] Instance spawned successfully.
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-e7c3ac63-26ba-4103-a191-41096bf18b33 req-497382a4-1a6d-43c6-8551-4abdf2630ca3 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Received event network-vif-plugged-8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e7c3ac63-26ba-4103-a191-41096bf18b33 req-497382a4-1a6d-43c6-8551-4abdf2630ca3 service nova] Acquiring lock "c8335ffd-314e-43f1-9573-200556415a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e7c3ac63-26ba-4103-a191-41096bf18b33 req-497382a4-1a6d-43c6-8551-4abdf2630ca3 service nova] Lock "c8335ffd-314e-43f1-9573-200556415a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e7c3ac63-26ba-4103-a191-41096bf18b33 req-497382a4-1a6d-43c6-8551-4abdf2630ca3 service nova] Lock "c8335ffd-314e-43f1-9573-200556415a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-e7c3ac63-26ba-4103-a191-41096bf18b33 req-497382a4-1a6d-43c6-8551-4abdf2630ca3 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] No waiting events found dispatching network-vif-plugged-8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:04:51 user nova-compute[75469]: WARNING nova.compute.manager [req-e7c3ac63-26ba-4103-a191-41096bf18b33 req-497382a4-1a6d-43c6-8551-4abdf2630ca3 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Received unexpected event network-vif-plugged-8367797e-d56a-42f1-a00c-87bbe5c43253 for instance with vm_state building and task_state spawning.
Nov 14 05:04:51 user nova-compute[75469]: INFO nova.compute.manager [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 14 05:04:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:04:52 user nova-compute[75469]: INFO nova.compute.manager [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Took 6.27 seconds to build instance.
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d4022a4-2587-480c-89ae-f84246adfa36 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "c8335ffd-314e-43f1-9573-200556415a14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.377s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:52 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4d0f0f5d-0fd7-4ef1-8431-e010764112ee is timed out.
Nov 14 05:04:52 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully detached device vdb from instance 4d0f0f5d-0fd7-4ef1-8431-e010764112ee from the live domain config.
Nov 14 05:04:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFmZNcTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:04:52 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b0c824-80cc-496a-af1d-20c8ea902e6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:04:52 user nova-compute[75469]: No targets found.
Nov 14 05:04:52 user nova-compute[75469]: iSNS:
Nov 14 05:04:52 user nova-compute[75469]: No targets found.
Nov 14 05:04:52 user nova-compute[75469]: STATIC:
Nov 14 05:04:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b
Nov 14 05:04:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:04:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:04:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd
Nov 14 05:04:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:04:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:04:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57
Nov 14 05:04:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:04:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:04:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c
Nov 14 05:04:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:04:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:04:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5
Nov 14 05:04:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:04:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:04:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:04:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:04:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:04:52 user nova-compute[75469]: FIRMWARE:
Nov 14 05:04:52 user nova-compute[75469]: No targets found.
Nov 14 05:04:52 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:04:52 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:04:52 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfc9ac9-e803-42ec-87a9-08079aec42ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4e30c2-6c22-461e-bac3-8f45d13ed149]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:52 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:52 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:52 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:52 user nova-compute[75469]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)
Nov 14 05:04:52 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:04:52 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:04:52 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:04:52 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:04:52 user nova-compute[75469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 (non-flash)
Nov 14 05:04:52 user nova-compute[75469]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)
Nov 14 05:04:52 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:04:52 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f640d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57'): ({'sde'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Removing single pathed devices sde {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e616829f-ac14-4de2-bf49-58bb97fe3e3a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7b8f95-0a8d-4c2f-9bc7-ddbdf0a36501]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Flushing IO for device /dev/sde {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0c8b96-7c53-4130-941e-f22a2e72af5b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[980a2970-64c8-4c6a-8036-52925b65601f]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e90659f-926b-4983-bf53-e265ccb58019]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e7d4ef-5dab-4ee6-aba5-1e5379de52f3]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57, portal: 172.16.0.220,3260]
Nov 14 05:04:52 user nova-compute[75469]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57, portal: 172.16.0.220,3260] successful.
Nov 14 05:04:52 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d776ced6-2a95-426c-aa78-0f134a525b57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7e40b1-09e4-4b05-a80a-107d4119c043]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] <== disconnect_volume: return (373ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:04:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG nova.objects.instance [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'flavor' on Instance uuid 4d0f0f5d-0fd7-4ef1-8431-e010764112ee {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9a8b087f-de2e-418d-8306-94ebf26dfedf tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.006s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:54 user nova-compute[75469]: INFO nova.compute.manager [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Terminating instance
Nov 14 05:04:54 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-bab40444-618f-41f7-a1a9-fbf057c79023 req-48184654-8616-4da4-92f9-a88902d085c8 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-vif-unplugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bab40444-618f-41f7-a1a9-fbf057c79023 req-48184654-8616-4da4-92f9-a88902d085c8 service nova] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bab40444-618f-41f7-a1a9-fbf057c79023 req-48184654-8616-4da4-92f9-a88902d085c8 service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bab40444-618f-41f7-a1a9-fbf057c79023 req-48184654-8616-4da4-92f9-a88902d085c8 service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-bab40444-618f-41f7-a1a9-fbf057c79023 req-48184654-8616-4da4-92f9-a88902d085c8 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] No waiting events found dispatching network-vif-unplugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-bab40444-618f-41f7-a1a9-fbf057c79023 req-48184654-8616-4da4-92f9-a88902d085c8 service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-vif-unplugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Instance destroyed successfully.
Nov 14 05:04:55 user nova-compute[75469]: DEBUG nova.objects.instance [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lazy-loading 'resources' on Instance uuid ff1ee641-8abc-4e0e-acfe-b48859a428da {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T04:59:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-365164676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-365164676',id=22,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSQD5bSfa6qdQEhwI0KK41rmx99sGIX2msv5MKh6/gRf59kjIsdfgHdVcu1dd5V/7yhtWKba787Gpp7+nUIS8kVdxt6A0/wjwfuOwzT00jhB6IpMWMYgl0xCInO61eY4g==',key_name='tempest-keypair-757025621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:03:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95fb1cdf42b04f37b025ed7385c4af37',ramdisk_id='',reservation_id='r-a50r03tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-41564664',owner_user_name='tempest-AttachVolumeShelveTestJSON-41564664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88fb3641cda04c96b925d7b83af359b6',uuid=ff1ee641-8abc-4e0e-acfe-b48859a428da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converting VIF {"id": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "address": "fa:16:3e:f5:7d:1b", "network": {"id": "cd56c8f2-3b5f-4535-b55e-daf6feb824e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-162113495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95fb1cdf42b04f37b025ed7385c4af37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e0b05c-1e", "ovs_interfaceid": "c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG os_vif [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3e0b05c-1e, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e20732aa-0d6c-4ecb-a88d-68a9855bcac4) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:55 user nova-compute[75469]: INFO os_vif [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6,network=Network(cd56c8f2-3b5f-4535-b55e-daf6feb824e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e0b05c-1e')
Nov 14 05:04:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Deleting instance files /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da_del
Nov 14 05:04:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Deletion of /opt/stack/data/nova/instances/ff1ee641-8abc-4e0e-acfe-b48859a428da_del complete
Nov 14 05:04:55 user nova-compute[75469]: INFO nova.compute.manager [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 05:04:55 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:04:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid 'ff1ee641-8abc-4e0e-acfe-b48859a428da' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ff1ee641-8abc-4e0e-acfe-b48859a428da' (instance-00000016)
Nov 14 05:04:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:04:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7666MB free_disk=24.958271026611328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a48d1c5d-db49-4609-9ca4-21f4578d8943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4d0f0f5d-0fd7-4ef1-8431-e010764112ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a8350c59-92c2-4348-bea4-482079ec0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance ff1ee641-8abc-4e0e-acfe-b48859a428da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance bedf3e65-8970-47a2-9a96-d8fcc14016e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c07c6b3f-e748-4a36-a018-2336000b716d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c8335ffd-314e-43f1-9573-200556415a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.manager [req-3ab1ae29-0bce-47f3-a99b-196258fdf0cb req-c1ab5996-de3b-4648-8a05-b81d684c081c service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3ab1ae29-0bce-47f3-a99b-196258fdf0cb req-c1ab5996-de3b-4648-8a05-b81d684c081c service nova] Acquiring lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3ab1ae29-0bce-47f3-a99b-196258fdf0cb req-c1ab5996-de3b-4648-8a05-b81d684c081c service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3ab1ae29-0bce-47f3-a99b-196258fdf0cb req-c1ab5996-de3b-4648-8a05-b81d684c081c service nova] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:56 user nova-compute[75469]: DEBUG nova.compute.manager [req-3ab1ae29-0bce-47f3-a99b-196258fdf0cb req-c1ab5996-de3b-4648-8a05-b81d684c081c service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] No waiting events found dispatching network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:04:56 user nova-compute[75469]: WARNING nova.compute.manager [req-3ab1ae29-0bce-47f3-a99b-196258fdf0cb req-c1ab5996-de3b-4648-8a05-b81d684c081c service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received unexpected event network-vif-plugged-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 for instance with vm_state active and task_state deleting.
Nov 14 05:04:57 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:04:57 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:04:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:04:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:57 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:04:57 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Took 2.13 seconds to deallocate network for instance.
Nov 14 05:04:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-a606db3a-c7d2-4000-996e-1dfecfe608c4 req-9b6fe1e2-9493-433e-8421-97f935c3536a service nova] [instance: ff1ee641-8abc-4e0e-acfe-b48859a428da] Received event network-vif-deleted-c3e0b05c-1e5b-4a2c-b83e-0f2fe4d3b1e6 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:04:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:04:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:04:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:04:58 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:04:58 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:04:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:58 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Deleted allocations for instance ff1ee641-8abc-4e0e-acfe-b48859a428da
Nov 14 05:04:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7944eeb9-221f-4dfc-9c64-1ede4144d40d tempest-AttachVolumeShelveTestJSON-41564664 tempest-AttachVolumeShelveTestJSON-41564664-project-member] Lock "ff1ee641-8abc-4e0e-acfe-b48859a428da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.801s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:04:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:04:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:04:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:04:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:04:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:04:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:04:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:04:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:01 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:05:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:04 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8350c59-92c2-4348-bea4-482079ec0f5a is timed out.
Nov 14 05:05:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully detached device vdb from instance a8350c59-92c2-4348-bea4-482079ec0f5a from the live domain config.
Nov 14 05:05:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lipMRIUd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:05:04 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f893dba-39fc-4c66-85de-9da85ae5b9c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:05:04 user nova-compute[75469]: No targets found.
Nov 14 05:05:04 user nova-compute[75469]: iSNS:
Nov 14 05:05:04 user nova-compute[75469]: No targets found.
Nov 14 05:05:04 user nova-compute[75469]: STATIC:
Nov 14 05:05:04 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b
Nov 14 05:05:04 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:04 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:04 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd
Nov 14 05:05:04 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:04 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:04 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c
Nov 14 05:05:04 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:04 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:04 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5
Nov 14 05:05:04 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:04 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:04 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:05:04 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:04 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:04 user nova-compute[75469]: FIRMWARE:
Nov 14 05:05:04 user nova-compute[75469]: No targets found.
Nov 14 05:05:04 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:05:04 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:05:04 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[663b4b1c-eea8-4bf7-ae02-2378a360b2c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bbea5e-d4af-49c6-9f09-32a0e7fe807f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:05:04 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:05:04 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:05:04 user nova-compute[75469]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)
Nov 14 05:05:04 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:05:04 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:05:04 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:05:04 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:05:04 user nova-compute[75469]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c (non-flash)
Nov 14 05:05:04 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:05:04 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c726710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c'): ({'sdf'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Removing single pathed devices sdf {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d764b-d87e-4f88-ad11-74508097419f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1829478-9c65-4690-9787-0b3385207157]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flushing IO for device /dev/sdf {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6cb5a4-5a83-4717-ae29-310c492d9093]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad954ff-c0c4-4023-9f16-b7107d2e2e33]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] SCSI volumes sdf have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a1c876-54a5-49cb-8355-3041caa04c17]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1e71d6-71dd-4bef-af7d-af8903eb7368]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c, portal: 172.16.0.220,3260]
Nov 14 05:05:04 user nova-compute[75469]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c, portal: 172.16.0.220,3260] successful.
Nov 14 05:05:04 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7572d61f-a232-4a22-842e-c18658a70c8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c29e359-ed18-4ad9-bdba-35bc0a258806]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] <== disconnect_volume: return (363ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:05:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG nova.objects.instance [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid a8350c59-92c2-4348-bea4-482079ec0f5a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f982b6ec-a821-4c52-8148-45e94569bc5a tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.818s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:05 user nova-compute[75469]: INFO nova.compute.manager [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Terminating instance
Nov 14 05:05:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-fb0e130c-56c6-42e9-9905-86a40da3d86d req-03a76bdf-0ee0-4c15-95b1-2253b4a9420f service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Received event network-vif-unplugged-82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb0e130c-56c6-42e9-9905-86a40da3d86d req-03a76bdf-0ee0-4c15-95b1-2253b4a9420f service nova] Acquiring lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb0e130c-56c6-42e9-9905-86a40da3d86d req-03a76bdf-0ee0-4c15-95b1-2253b4a9420f service nova] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb0e130c-56c6-42e9-9905-86a40da3d86d req-03a76bdf-0ee0-4c15-95b1-2253b4a9420f service nova] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-fb0e130c-56c6-42e9-9905-86a40da3d86d req-03a76bdf-0ee0-4c15-95b1-2253b4a9420f service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] No waiting events found dispatching network-vif-unplugged-82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-fb0e130c-56c6-42e9-9905-86a40da3d86d req-03a76bdf-0ee0-4c15-95b1-2253b4a9420f service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Received event network-vif-unplugged-82213486-add3-44cd-ae78-b7768d777154 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Instance destroyed successfully.
Nov 14 05:05:06 user nova-compute[75469]: DEBUG nova.objects.instance [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'resources' on Instance uuid bedf3e65-8970-47a2-9a96-d8fcc14016e5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:06 user nova-compute[75469]: INFO nova.compute.manager [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Detaching volume a2baab7f-5cfb-413b-9006-1ac2f592ef0b
Nov 14 05:05:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1296212139',display_name='tempest-TestVolumeBootPattern-server-1296212139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1296212139',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:03:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-5oimly20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:03:31Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=bedf3e65-8970-47a2-9a96-d8fcc14016e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82213486-add3-44cd-ae78-b7768d777154", "address": "fa:16:3e:6c:75:46", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82213486-ad", "ovs_interfaceid": "82213486-add3-44cd-ae78-b7768d777154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "82213486-add3-44cd-ae78-b7768d777154", "address": "fa:16:3e:6c:75:46", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82213486-ad", "ovs_interfaceid": "82213486-add3-44cd-ae78-b7768d777154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=82213486-add3-44cd-ae78-b7768d777154,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82213486-ad') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_vif [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=82213486-add3-44cd-ae78-b7768d777154,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82213486-ad') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82213486-ad, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3784d097-3dbe-424d-a8ab-115e37bd9a4a) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:06 user nova-compute[75469]: INFO os_vif [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=82213486-add3-44cd-ae78-b7768d777154,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82213486-ad')
Nov 14 05:05:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSlPLHQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:05:06 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c9e66b-461e-42ec-83f6-7e0e0dfe4144]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:05:06 user nova-compute[75469]: No targets found.
Nov 14 05:05:06 user nova-compute[75469]: iSNS:
Nov 14 05:05:06 user nova-compute[75469]: No targets found.
Nov 14 05:05:06 user nova-compute[75469]: STATIC:
Nov 14 05:05:06 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b
Nov 14 05:05:06 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:06 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:06 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd
Nov 14 05:05:06 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:06 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:06 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5
Nov 14 05:05:06 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:06 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:06 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:05:06 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:06 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:06 user nova-compute[75469]: FIRMWARE:
Nov 14 05:05:06 user nova-compute[75469]: No targets found.
Nov 14 05:05:06 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:05:06 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:05:06 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:05:06 user nova-compute[75469]: INFO nova.virt.block_device [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Attempting to driver detach volume a2baab7f-5cfb-413b-9006-1ac2f592ef0b from mountpoint /dev/vdc
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Attempting to detach device vdc from instance a8350c59-92c2-4348-bea4-482079ec0f5a from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:05:06 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:05:06 user nova-compute[75469]:   <source dev="/dev/sdg"/>
Nov 14 05:05:06 user nova-compute[75469]:   <target dev="vdc" bus="virtio"/>
Nov 14 05:05:06 user nova-compute[75469]:   <serial>a2baab7f-5cfb-413b-9006-1ac2f592ef0b</serial>
Nov 14 05:05:06 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 05:05:06 user nova-compute[75469]: </disk>
Nov 14 05:05:06 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbec9a47-e313-46d9-a74d-e4ea9f190b55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully detached device vdc from instance a8350c59-92c2-4348-bea4-482079ec0f5a from the persistent domain config.
Nov 14 05:05:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a8350c59-92c2-4348-bea4-482079ec0f5a from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:05:06 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:05:06 user nova-compute[75469]:   <source dev="/dev/sdg"/>
Nov 14 05:05:06 user nova-compute[75469]:   <target dev="vdc" bus="virtio"/>
Nov 14 05:05:06 user nova-compute[75469]:   <serial>a2baab7f-5cfb-413b-9006-1ac2f592ef0b</serial>
Nov 14 05:05:06 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 05:05:06 user nova-compute[75469]: </disk>
Nov 14 05:05:06 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ad61bb-a578-4fdf-a366-6e1f25aefaeb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:05:06 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:05:06 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:05:06 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:05:06 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:05:06 user nova-compute[75469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd (non-flash)
Nov 14 05:05:06 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:05:06 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:05:06 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa74c2fd870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd'): ({'sdd'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Removing single pathed devices sdd {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87347aa-9b22-4e80-b6c5-55833f3c4bf5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6188708-fa3a-4d46-82ff-f7d64b67f35c]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flushing IO for device /dev/sdd {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[574a9ccc-c0e8-46e9-b3a5-30cec4fc0d35]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5440c59c-7420-44d3-9909-e3af41ed6ad5]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6461cfd3', '/dev/disk/by-id/scsi-1SCST_BIO6461cfd3-c5266199574825de', '/dev/disk/by-id/scsi-26335323636313939') {{(pid=85531) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc94809f-3174-4328-b3a1-51e61acbd553]: (4, None) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3abee19-aaa5-449c-be75-2ef9a9d67627]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdddb9b-9df7-44b7-ade7-76031ebd3745]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd, portal: 172.16.0.220,3260]
Nov 14 05:05:06 user nova-compute[75469]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd, portal: 172.16.0.220,3260] successful.
Nov 14 05:05:06 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34897bc0-9ccd-4cba-b347-28e03f5abcbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6f98d3-5295-49f2-ad10-0be9e15edc70]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.497s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== disconnect_volume: return (498ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:05:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:05:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Deleting instance files /opt/stack/data/nova/instances/bedf3e65-8970-47a2-9a96-d8fcc14016e5_del
Nov 14 05:05:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Deletion of /opt/stack/data/nova/instances/bedf3e65-8970-47a2-9a96-d8fcc14016e5_del complete
Nov 14 05:05:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a8350c59-92c2-4348-bea4-482079ec0f5a {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:05:07 user nova-compute[75469]: INFO nova.compute.manager [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Took 1.44 seconds to destroy the instance on the hypervisor.
Nov 14 05:05:07 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:05:07 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:05:07 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:05:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-f234f1fd-132b-48de-9bb9-c378e3cec02f req-f529aaa7-a6a9-4401-82c4-29f395a5e297 service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Received event network-vif-plugged-82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f234f1fd-132b-48de-9bb9-c378e3cec02f req-f529aaa7-a6a9-4401-82c4-29f395a5e297 service nova] Acquiring lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f234f1fd-132b-48de-9bb9-c378e3cec02f req-f529aaa7-a6a9-4401-82c4-29f395a5e297 service nova] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f234f1fd-132b-48de-9bb9-c378e3cec02f req-f529aaa7-a6a9-4401-82c4-29f395a5e297 service nova] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-f234f1fd-132b-48de-9bb9-c378e3cec02f req-f529aaa7-a6a9-4401-82c4-29f395a5e297 service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] No waiting events found dispatching network-vif-plugged-82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:07 user nova-compute[75469]: WARNING nova.compute.manager [req-f234f1fd-132b-48de-9bb9-c378e3cec02f req-f529aaa7-a6a9-4401-82c4-29f395a5e297 service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Received unexpected event network-vif-plugged-82213486-add3-44cd-ae78-b7768d777154 for instance with vm_state active and task_state deleting.
Nov 14 05:05:08 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:05:08 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Took 1.00 seconds to deallocate network for instance.
Nov 14 05:05:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-84dbfab1-18f6-49d5-af81-700d1c22f030 req-76447bd7-8ed8-4c87-a0ae-a8bac89a4396 service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Received event network-vif-deleted-82213486-add3-44cd-ae78-b7768d777154 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:08 user nova-compute[75469]: INFO nova.compute.manager [req-84dbfab1-18f6-49d5-af81-700d1c22f030 req-76447bd7-8ed8-4c87-a0ae-a8bac89a4396 service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Neutron deleted interface 82213486-add3-44cd-ae78-b7768d777154; detaching it from the instance and deleting it from the info cache
Nov 14 05:05:08 user nova-compute[75469]: DEBUG nova.network.neutron [req-84dbfab1-18f6-49d5-af81-700d1c22f030 req-76447bd7-8ed8-4c87-a0ae-a8bac89a4396 service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:05:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-84dbfab1-18f6-49d5-af81-700d1c22f030 req-76447bd7-8ed8-4c87-a0ae-a8bac89a4396 service nova] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Detach interface failed, port_id=82213486-add3-44cd-ae78-b7768d777154, reason: Instance bedf3e65-8970-47a2-9a96-d8fcc14016e5 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:05:08 user nova-compute[75469]: INFO nova.compute.manager [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Took 0.83 seconds to detach 1 volumes for instance.
Nov 14 05:05:08 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: bedf3e65-8970-47a2-9a96-d8fcc14016e5] Deleting volume: 34897bc0-9ccd-4cba-b347-28e03f5abcbd {{(pid=75469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 05:05:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:09 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:05:09 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:05:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:09 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Deleted allocations for instance bedf3e65-8970-47a2-9a96-d8fcc14016e5
Nov 14 05:05:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d8fd28d0-88f1-4f3b-bcaf-eeb4a5f967b7 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "bedf3e65-8970-47a2-9a96-d8fcc14016e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.838s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:11 user nova-compute[75469]: INFO nova.compute.manager [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Rescuing
Nov 14 05:05:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:05:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquired lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:05:11 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:05:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:11 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Updating instance_info_cache with network_info: [{"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:05:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Releasing lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:05:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Instance destroyed successfully.
Nov 14 05:05:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Attempting a stable device rescue
Nov 14 05:05:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Instance directory exists: not creating {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 05:05:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Creating image(s)
Nov 14 05:05:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "/opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "/opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "/opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'trusted_certs' on Instance uuid c07c6b3f-e748-4a36-a018-2336000b716d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "aa870f0206a5308acce37417ef1f1c700b74c40b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "aa870f0206a5308acce37417ef1f1c700b74c40b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-05d18a88-6736-42c6-92c3-e2c46ac27fb1 req-58f62b05-e39b-4fc2-aae3-7d111ec6c3c8 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-unplugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-05d18a88-6736-42c6-92c3-e2c46ac27fb1 req-58f62b05-e39b-4fc2-aae3-7d111ec6c3c8 service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-05d18a88-6736-42c6-92c3-e2c46ac27fb1 req-58f62b05-e39b-4fc2-aae3-7d111ec6c3c8 service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-05d18a88-6736-42c6-92c3-e2c46ac27fb1 req-58f62b05-e39b-4fc2-aae3-7d111ec6c3c8 service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-05d18a88-6736-42c6-92c3-e2c46ac27fb1 req-58f62b05-e39b-4fc2-aae3-7d111ec6c3c8 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-unplugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:12 user nova-compute[75469]: WARNING nova.compute.manager [req-05d18a88-6736-42c6-92c3-e2c46ac27fb1 req-58f62b05-e39b-4fc2-aae3-7d111ec6c3c8 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received unexpected event network-vif-unplugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with vm_state active and task_state rescuing.
Nov 14 05:05:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b.part --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:13 user nova-compute[75469]: DEBUG nova.virt.images [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] 275adc14-69a7-4dd1-88ae-2f285585c5bf was qcow2, converting to raw {{(pid=75469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 05:05:13 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 05:05:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b.part /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b.converted {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b.part /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b.converted" returned: 0 in 0.620s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b.converted --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-7ddf514a-70b2-4be4-83b8-046fd41308f0 req-c1c86b7e-6f47-4fd9-bccc-9f380739f41f service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7ddf514a-70b2-4be4-83b8-046fd41308f0 req-c1c86b7e-6f47-4fd9-bccc-9f380739f41f service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7ddf514a-70b2-4be4-83b8-046fd41308f0 req-c1c86b7e-6f47-4fd9-bccc-9f380739f41f service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7ddf514a-70b2-4be4-83b8-046fd41308f0 req-c1c86b7e-6f47-4fd9-bccc-9f380739f41f service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-7ddf514a-70b2-4be4-83b8-046fd41308f0 req-c1c86b7e-6f47-4fd9-bccc-9f380739f41f service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:14 user nova-compute[75469]: WARNING nova.compute.manager [req-7ddf514a-70b2-4be4-83b8-046fd41308f0 req-c1c86b7e-6f47-4fd9-bccc-9f380739f41f service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received unexpected event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with vm_state active and task_state rescuing.
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "aa870f0206a5308acce37417ef1f1c700b74c40b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.109s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "aa870f0206a5308acce37417ef1f1c700b74c40b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "aa870f0206a5308acce37417ef1f1c700b74c40b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b,backing_fmt=raw /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.rescue {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b,backing_fmt=raw /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.rescue" returned: 0 in 0.053s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "aa870f0206a5308acce37417ef1f1c700b74c40b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'migration_context' on Instance uuid c07c6b3f-e748-4a36-a018-2336000b716d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.objects.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Object Instance<c07c6b3f-e748-4a36-a018-2336000b716d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Start _get_guest_xml network_info=[{"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "vif_mac": "fa:16:3e:e0:e9:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '275adc14-69a7-4dd1-88ae-2f285585c5bf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'de47916e-29e3-4aed-9b1a-8d48505517fe', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCGaAeQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c07c6b3f-e748-4a36-a018-2336000b716d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c09ea236-173a-42bb-8248-490aef5baba5', 'serial': 'c09ea236-173a-42bb-8248-490aef5baba5'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'resources' on Instance uuid c07c6b3f-e748-4a36-a018-2336000b716d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.objects.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Object Instance<c07c6b3f-e748-4a36-a018-2336000b716d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'numa_topology' on Instance uuid c07c6b3f-e748-4a36-a018-2336000b716d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.objects.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Object Instance<c07c6b3f-e748-4a36-a018-2336000b716d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:05:14 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:05:14 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:05:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'vcpu_model' on Instance uuid c07c6b3f-e748-4a36-a018-2336000b716d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.objects.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Object Instance<c07c6b3f-e748-4a36-a018-2336000b716d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCGaAeQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:05:15 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:05:15 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:05:15 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e631d6cb-6306-4058-8fe4-6367049382dd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UCGaAeQg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 05:05:15 user nova-compute[75469]: node.name = iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5
Nov 14 05:05:15 user nova-compute[75469]: node.tpgt = -1
Nov 14 05:05:15 user nova-compute[75469]: node.startup = automatic
Nov 14 05:05:15 user nova-compute[75469]: node.leading_login = No
Nov 14 05:05:15 user nova-compute[75469]: iface.iscsi_ifacename = default
Nov 14 05:05:15 user nova-compute[75469]: iface.net_ifacename = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.ipaddress = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.prefix_len = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.hwaddress = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.transport_name = tcp
Nov 14 05:05:15 user nova-compute[75469]: iface.initiatorname = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.state = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.vlan_id = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.vlan_priority = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.vlan_state = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.iface_num = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.mtu = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.port = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.bootproto = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.subnet_mask = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.gateway = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.dhcp_alt_client_id = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.dhcp_dns = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.dhcp_learn_iqn = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.dhcp_vendor_id_state = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.dhcp_vendor_id = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.dhcp_slp_da = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.fragmentation = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.gratuitous_arp = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.incoming_forwarding = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.tos_state = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.tos = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.ttl = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.delayed_ack = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.tcp_nagle = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.tcp_wsf_state = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.tcp_wsf = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.tcp_timer_scale = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.tcp_timestamp = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.redirect = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.def_task_mgmt_timeout = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.header_digest = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.data_digest = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.immediate_data = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.initial_r2t = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.data_seq_inorder = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.data_pdu_inorder = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.erl = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.max_receive_data_len = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.first_burst_len = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.max_outstanding_r2t = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.max_burst_len = 0
Nov 14 05:05:15 user nova-compute[75469]: iface.chap_auth = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.bidi_chap = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.strict_login_compliance = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.discovery_auth = <empty>
Nov 14 05:05:15 user nova-compute[75469]: iface.discovery_logout = <empty>
Nov 14 05:05:15 user nova-compute[75469]: node.discovery_address = <empty>
Nov 14 05:05:15 user nova-compute[75469]: node.discovery_port = 0
Nov 14 05:05:15 user nova-compute[75469]: node.discovery_type = static
Nov 14 05:05:15 user nova-compute[75469]: node.session.initial_cmdsn = 0
Nov 14 05:05:15 user nova-compute[75469]: node.session.initial_login_retry_max = 8
Nov 14 05:05:15 user nova-compute[75469]: node.session.xmit_thread_priority = -20
Nov 14 05:05:15 user nova-compute[75469]: node.session.cmds_max = 128
Nov 14 05:05:15 user nova-compute[75469]: node.session.queue_depth = 32
Nov 14 05:05:15 user nova-compute[75469]: node.session.nr_sessions = 1
Nov 14 05:05:15 user nova-compute[75469]: node.session.auth.authmethod = CHAP
Nov 14 05:05:15 user nova-compute[75469]: node.session.auth.username = UCGaAeQg
Nov 14 05:05:15 user nova-compute[75469]: node.session.auth.password = ***
Nov 14 05:05:15 user nova-compute[75469]: node.session.auth.username_in = <empty>
Nov 14 05:05:15 user nova-compute[75469]: node.session.auth.password_in = <empty>
Nov 14 05:05:15 user nova-compute[75469]: node.session.auth.chap_algs = MD5
Nov 14 05:05:15 user nova-compute[75469]: node.session.timeo.replacement_timeout = 120
Nov 14 05:05:15 user nova-compute[75469]: node.session.err_timeo.abort_timeout = 15
Nov 14 05:05:15 user nova-compute[75469]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 05:05:15 user nova-compute[75469]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 05:05:15 user nova-compute[75469]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 05:05:15 user nova-compute[75469]: node.session.iscsi.FastAbort = Yes
Nov 14 05:05:15 user nova-compute[75469]: node.session.iscsi.InitialR2T = No
Nov 14 05:05:15 user nova-compute[75469]: node.session.iscsi.ImmediateData = Yes
Nov 14 05:05:15 user nova-compute[75469]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 05:05:15 user nova-compute[75469]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 05:05:15 user nova-compute[75469]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 05:05:15 user nova-compute[75469]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 05:05:15 user nova-compute[75469]: node.session.iscsi.MaxConnections = 1
Nov 14 05:05:15 user nova-compute[75469]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 05:05:15 user nova-compute[75469]: node.session.iscsi.ERL = 0
Nov 14 05:05:15 user nova-compute[75469]: node.session.scan = manual
Nov 14 05:05:15 user nova-compute[75469]: node.session.reopen_max = 0
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].address = 172.16.0.220
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].port = 3260
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].startup = manual
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].tcp.window_size = 524288
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].tcp.type_of_service = 0
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].timeo.logout_timeout = 15
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].timeo.login_timeout = 15
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].timeo.auth_timeout = 45
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].iscsi.DataDigest = None
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].iscsi.IFMarker = No
Nov 14 05:05:15 user nova-compute[75469]: node.conn[0].iscsi.OFMarker = No
Nov 14 05:05:15 user nova-compute[75469]: # END RECORD
Nov 14 05:05:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f405720e-7d7a-4563-a2a4-b9e8b0a5c68c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05c6cdc-00e7-4744-8dd2-8a269836e5c3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCGaAeQg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCGaAeQg" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7055f66-d091-47c8-a44b-412d11be6b35]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UCGaAeQg'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a34a597-6cf6-410c-99c1-64f2e3678314]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21461bc-1a0f-418a-8820-ed2385ba1295]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:05:15 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:05:15 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:05:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:05:15 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:05:15 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:05:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] HCTL ('33', '0', '0', 0) found on session 34 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0b5ee8-015f-46a2-981e-184f68ab98cd]: (4, ('0 0 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Searching for a device in session 34 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCGaAeQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23335346261356436', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335346261356436', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:03:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-96373400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-96373400',id=31,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-6ra00e0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:03:38Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=c07c6b3f-e748-4a36-a018-2336000b716d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "vif_mac": "fa:16:3e:e0:e9:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "vif_mac": "fa:16:3e:e0:e9:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e9:2e,bridge_name='br-int',has_traffic_filtering=True,id=9e47e54c-fc40-4577-bb19-f8f9c6a73a68,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e47e54c-fc') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'pci_devices' on Instance uuid c07c6b3f-e748-4a36-a018-2336000b716d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.objects.base [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Object Instance<c07c6b3f-e748-4a36-a018-2336000b716d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:05:15 user nova-compute[75469]:   <uuid>c07c6b3f-e748-4a36-a018-2336000b716d</uuid>
Nov 14 05:05:15 user nova-compute[75469]:   <name>instance-0000001f</name>
Nov 14 05:05:15 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:05:15 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:05:15 user nova-compute[75469]:   <metadata>
Nov 14 05:05:15 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:05:15 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:05:15 user nova-compute[75469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-96373400</nova:name>
Nov 14 05:05:15 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:05:14</nova:creationTime>
Nov 14 05:05:15 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:05:15 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:05:15 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:05:15 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:05:15 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:05:15 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:05:15 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:05:15 user nova-compute[75469]:       <nova:owner>
Nov 14 05:05:15 user nova-compute[75469]:         <nova:user uuid="3a23a8feda3e4d7581666ca3ee20aa5f">tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member</nova:user>
Nov 14 05:05:15 user nova-compute[75469]:         <nova:project uuid="e392b9dd841a4eacab6c4aff4f60e536">tempest-ServerBootFromVolumeStableRescueTest-1634984639</nova:project>
Nov 14 05:05:15 user nova-compute[75469]:       </nova:owner>
Nov 14 05:05:15 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:05:15 user nova-compute[75469]:       <nova:ports>
Nov 14 05:05:15 user nova-compute[75469]:         <nova:port uuid="9e47e54c-fc40-4577-bb19-f8f9c6a73a68">
Nov 14 05:05:15 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 05:05:15 user nova-compute[75469]:         </nova:port>
Nov 14 05:05:15 user nova-compute[75469]:       </nova:ports>
Nov 14 05:05:15 user nova-compute[75469]:     </nova:instance>
Nov 14 05:05:15 user nova-compute[75469]:   </metadata>
Nov 14 05:05:15 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:05:15 user nova-compute[75469]:     <system>
Nov 14 05:05:15 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:05:15 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:05:15 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:05:15 user nova-compute[75469]:       <entry name="serial">c07c6b3f-e748-4a36-a018-2336000b716d</entry>
Nov 14 05:05:15 user nova-compute[75469]:       <entry name="uuid">c07c6b3f-e748-4a36-a018-2336000b716d</entry>
Nov 14 05:05:15 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:05:15 user nova-compute[75469]:     </system>
Nov 14 05:05:15 user nova-compute[75469]:   </sysinfo>
Nov 14 05:05:15 user nova-compute[75469]:   <os>
Nov 14 05:05:15 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:05:15 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:05:15 user nova-compute[75469]:   </os>
Nov 14 05:05:15 user nova-compute[75469]:   <features>
Nov 14 05:05:15 user nova-compute[75469]:     <acpi/>
Nov 14 05:05:15 user nova-compute[75469]:     <apic/>
Nov 14 05:05:15 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:05:15 user nova-compute[75469]:   </features>
Nov 14 05:05:15 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:05:15 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:05:15 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:05:15 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:05:15 user nova-compute[75469]:   </clock>
Nov 14 05:05:15 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:05:15 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:05:15 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:05:15 user nova-compute[75469]:   </cpu>
Nov 14 05:05:15 user nova-compute[75469]:   <devices>
Nov 14 05:05:15 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:05:15 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:05:15 user nova-compute[75469]:       <source dev="/dev/sdb"/>
Nov 14 05:05:15 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:05:15 user nova-compute[75469]:       <serial>c09ea236-173a-42bb-8248-490aef5baba5</serial>
Nov 14 05:05:15 user nova-compute[75469]:     </disk>
Nov 14 05:05:15 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:05:15 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:05:15 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.rescue"/>
Nov 14 05:05:15 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 05:05:15 user nova-compute[75469]:       <boot order="1"/>
Nov 14 05:05:15 user nova-compute[75469]:     </disk>
Nov 14 05:05:15 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:05:15 user nova-compute[75469]:       <mac address="fa:16:3e:e0:e9:2e"/>
Nov 14 05:05:15 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:05:15 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:05:15 user nova-compute[75469]:       <target dev="tap9e47e54c-fc"/>
Nov 14 05:05:15 user nova-compute[75469]:     </interface>
Nov 14 05:05:15 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:05:15 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/console.log" append="off"/>
Nov 14 05:05:15 user nova-compute[75469]:     </serial>
Nov 14 05:05:15 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:05:15 user nova-compute[75469]:     <video>
Nov 14 05:05:15 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:05:15 user nova-compute[75469]:     </video>
Nov 14 05:05:15 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:05:15 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:05:15 user nova-compute[75469]:     </rng>
Nov 14 05:05:15 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:05:15 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:05:15 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:05:15 user nova-compute[75469]:     </memballoon>
Nov 14 05:05:15 user nova-compute[75469]:   </devices>
Nov 14 05:05:15 user nova-compute[75469]: </domain>
Nov 14 05:05:15 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:05:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Instance destroyed successfully.
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:05:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] No VIF found with MAC fa:16:3e:e0:e9:2e, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:05:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-d748cca1-4d94-447c-8936-833a800ea670 req-a2eca62d-f84f-477d-81b3-c032db6a5c6a service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d748cca1-4d94-447c-8936-833a800ea670 req-a2eca62d-f84f-477d-81b3-c032db6a5c6a service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d748cca1-4d94-447c-8936-833a800ea670 req-a2eca62d-f84f-477d-81b3-c032db6a5c6a service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d748cca1-4d94-447c-8936-833a800ea670 req-a2eca62d-f84f-477d-81b3-c032db6a5c6a service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-d748cca1-4d94-447c-8936-833a800ea670 req-a2eca62d-f84f-477d-81b3-c032db6a5c6a service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:17 user nova-compute[75469]: WARNING nova.compute.manager [req-d748cca1-4d94-447c-8936-833a800ea670 req-a2eca62d-f84f-477d-81b3-c032db6a5c6a service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received unexpected event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with vm_state active and task_state rescuing.
Nov 14 05:05:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4cdfc4d3-0061-4a37-9da7-e5f2d81a1eb3 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:05:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-48956e27-fb85-4ceb-a52f-f1041e52bb86 req-4e6af4e7-eb03-46b7-9b50-13b30690918b service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-48956e27-fb85-4ceb-a52f-f1041e52bb86 req-4e6af4e7-eb03-46b7-9b50-13b30690918b service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-48956e27-fb85-4ceb-a52f-f1041e52bb86 req-4e6af4e7-eb03-46b7-9b50-13b30690918b service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-48956e27-fb85-4ceb-a52f-f1041e52bb86 req-4e6af4e7-eb03-46b7-9b50-13b30690918b service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-48956e27-fb85-4ceb-a52f-f1041e52bb86 req-4e6af4e7-eb03-46b7-9b50-13b30690918b service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:19 user nova-compute[75469]: WARNING nova.compute.manager [req-48956e27-fb85-4ceb-a52f-f1041e52bb86 req-4e6af4e7-eb03-46b7-9b50-13b30690918b service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received unexpected event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with vm_state rescued and task_state None.
Nov 14 05:05:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:22 user nova-compute[75469]: INFO nova.compute.manager [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Terminating instance
Nov 14 05:05:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-7d5cdca5-d7ea-4b96-830a-ca3ae6fe8565 req-0b750a6a-5799-47e9-aeb1-73e01ceeff7b service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Received event network-vif-unplugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7d5cdca5-d7ea-4b96-830a-ca3ae6fe8565 req-0b750a6a-5799-47e9-aeb1-73e01ceeff7b service nova] Acquiring lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7d5cdca5-d7ea-4b96-830a-ca3ae6fe8565 req-0b750a6a-5799-47e9-aeb1-73e01ceeff7b service nova] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7d5cdca5-d7ea-4b96-830a-ca3ae6fe8565 req-0b750a6a-5799-47e9-aeb1-73e01ceeff7b service nova] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-7d5cdca5-d7ea-4b96-830a-ca3ae6fe8565 req-0b750a6a-5799-47e9-aeb1-73e01ceeff7b service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] No waiting events found dispatching network-vif-unplugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-7d5cdca5-d7ea-4b96-830a-ca3ae6fe8565 req-0b750a6a-5799-47e9-aeb1-73e01ceeff7b service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Received event network-vif-unplugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:05:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Instance destroyed successfully.
Nov 14 05:05:23 user nova-compute[75469]: DEBUG nova.objects.instance [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'resources' on Instance uuid 4d0f0f5d-0fd7-4ef1-8431-e010764112ee {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-618939133',display_name='tempest-AttachVolumeNegativeTest-server-618939133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-618939133',id=28,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgD5EbpgDAWYxon+ZVbyzskI+1DqQzKqlUf2wCnnMyidpkooJi76RJkYS3xVSXueU+Y55jYlJkUeIdzhaSKdUWVB8g44Y6bAbwXEZjGWPE8HkPaTC93dEoJa9uI7dJ75w==',key_name='tempest-keypair-2049472258',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:02:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-hxq6hnxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:02:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=4d0f0f5d-0fd7-4ef1-8431-e010764112ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "address": "fa:16:3e:f9:f5:91", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09ee5b7-60", "ovs_interfaceid": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "address": "fa:16:3e:f9:f5:91", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09ee5b7-60", "ovs_interfaceid": "b09ee5b7-60ed-43d1-8a22-55f4e1dedf59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=b09ee5b7-60ed-43d1-8a22-55f4e1dedf59,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09ee5b7-60') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG os_vif [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=b09ee5b7-60ed-43d1-8a22-55f4e1dedf59,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09ee5b7-60') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb09ee5b7-60, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd03f0b1-1a68-444c-8bb6-4a3bd1dd12bc) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:05:23 user nova-compute[75469]: INFO os_vif [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:f5:91,bridge_name='br-int',has_traffic_filtering=True,id=b09ee5b7-60ed-43d1-8a22-55f4e1dedf59,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09ee5b7-60')
Nov 14 05:05:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Deleting instance files /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee_del
Nov 14 05:05:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Deletion of /opt/stack/data/nova/instances/4d0f0f5d-0fd7-4ef1-8431-e010764112ee_del complete
Nov 14 05:05:23 user nova-compute[75469]: INFO nova.compute.manager [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 14 05:05:23 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "87874095-a320-4445-8dd3-b7b259764dfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:05:24 user nova-compute[75469]: INFO nova.compute.claims [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Claim successful on node user
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:05:24 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Took 0.94 seconds to deallocate network for instance.
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-05ea3eff-9579-4d7d-b1ca-10b1a02f8013 req-9387136f-c0a1-4ba3-baca-68828a2ddc47 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Received event network-vif-deleted-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:24 user nova-compute[75469]: INFO nova.compute.manager [req-05ea3eff-9579-4d7d-b1ca-10b1a02f8013 req-9387136f-c0a1-4ba3-baca-68828a2ddc47 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Neutron deleted interface b09ee5b7-60ed-43d1-8a22-55f4e1dedf59; detaching it from the instance and deleting it from the info cache
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.network.neutron [req-05ea3eff-9579-4d7d-b1ca-10b1a02f8013 req-9387136f-c0a1-4ba3-baca-68828a2ddc47 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-05ea3eff-9579-4d7d-b1ca-10b1a02f8013 req-9387136f-c0a1-4ba3-baca-68828a2ddc47 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Detach interface failed, port_id=b09ee5b7-60ed-43d1-8a22-55f4e1dedf59, reason: Instance 4d0f0f5d-0fd7-4ef1-8431-e010764112ee could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.076s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.network.neutron [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:05:24 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.policy [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aee00a8861b64c90aef13e13ca17b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a227a14762d241479644c6bfdf340bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-61197b4d-a033-4eae-9104-9ab18a2a93b6 req-f63fa82c-917e-42c1-b89c-99a09a613807 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Received event network-vif-plugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-61197b4d-a033-4eae-9104-9ab18a2a93b6 req-f63fa82c-917e-42c1-b89c-99a09a613807 service nova] Acquiring lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-61197b4d-a033-4eae-9104-9ab18a2a93b6 req-f63fa82c-917e-42c1-b89c-99a09a613807 service nova] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-61197b4d-a033-4eae-9104-9ab18a2a93b6 req-f63fa82c-917e-42c1-b89c-99a09a613807 service nova] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-61197b4d-a033-4eae-9104-9ab18a2a93b6 req-f63fa82c-917e-42c1-b89c-99a09a613807 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] No waiting events found dispatching network-vif-plugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:24 user nova-compute[75469]: WARNING nova.compute.manager [req-61197b4d-a033-4eae-9104-9ab18a2a93b6 req-f63fa82c-917e-42c1-b89c-99a09a613807 service nova] [instance: 4d0f0f5d-0fd7-4ef1-8431-e010764112ee] Received unexpected event network-vif-plugged-b09ee5b7-60ed-43d1-8a22-55f4e1dedf59 for instance with vm_state deleted and task_state None.
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:05:24 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Creating image(s)
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "/opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "/opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "/opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.191s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:25 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Deleted allocations for instance 4d0f0f5d-0fd7-4ef1-8431-e010764112ee
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bfcd0c38-a536-4e78-81b4-a7bc79b9d857 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "4d0f0f5d-0fd7-4ef1-8431-e010764112ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.797s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.215s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk 1073741824" returned: 0 in 0.057s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.192s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG nova.network.neutron [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Successfully created port: e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Cannot resize image /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Ensure instance console log exists: /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Successfully updated port: e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquired lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-1a54ae7f-f1c4-46d4-aabb-1b38149e5e23 req-11ba535b-4e78-4a10-b313-a19e6665a0ef service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received event network-changed-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-1a54ae7f-f1c4-46d4-aabb-1b38149e5e23 req-11ba535b-4e78-4a10-b313-a19e6665a0ef service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Refreshing instance network info cache due to event network-changed-e410b203-a06b-4d47-b021-cd273d307573. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1a54ae7f-f1c4-46d4-aabb-1b38149e5e23 req-11ba535b-4e78-4a10-b313-a19e6665a0ef service nova] Acquiring lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Updating instance_info_cache with network_info: [{"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Releasing lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Instance network_info: |[{"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1a54ae7f-f1c4-46d4-aabb-1b38149e5e23 req-11ba535b-4e78-4a10-b313-a19e6665a0ef service nova] Acquired lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-1a54ae7f-f1c4-46d4-aabb-1b38149e5e23 req-11ba535b-4e78-4a10-b313-a19e6665a0ef service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Refreshing network info cache for port e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Start _get_guest_xml network_info=[{"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:05:26 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:05:26 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-610960302',display_name='tempest-TestStampPattern-server-610960302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-610960302',id=33,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIbprXKukdzTIGKQy5CdrYJsNjT3KMcr1m2DCPZxsN4W045qdvgMW40zZ6YaNfSahpFUhbzXXXrWBXhMt7BGmhkttHYyfVM1bsmzIIYbrZC/EfH3ShlUu1reGi0vZx7ZQ==',key_name='tempest-TestStampPattern-1132364811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a227a14762d241479644c6bfdf340bee',ramdisk_id='',reservation_id='r-1dh873ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1299350604',owner_user_name='tempest-TestStampPattern-1299350604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:05:25Z,user_data=None,user_id='aee00a8861b64c90aef13e13ca17b8d0',uuid=87874095-a320-4445-8dd3-b7b259764dfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converting VIF {"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=e410b203-a06b-4d47-b021-cd273d307573,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape410b203-a0') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.objects.instance [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lazy-loading 'pci_devices' on Instance uuid 87874095-a320-4445-8dd3-b7b259764dfa {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:05:26 user nova-compute[75469]:   <uuid>87874095-a320-4445-8dd3-b7b259764dfa</uuid>
Nov 14 05:05:26 user nova-compute[75469]:   <name>instance-00000021</name>
Nov 14 05:05:26 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:05:26 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:05:26 user nova-compute[75469]:   <metadata>
Nov 14 05:05:26 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:05:26 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:05:26 user nova-compute[75469]:       <nova:name>tempest-TestStampPattern-server-610960302</nova:name>
Nov 14 05:05:26 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:05:26</nova:creationTime>
Nov 14 05:05:26 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:05:26 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:05:26 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:05:26 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:05:26 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:05:26 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:05:26 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:05:26 user nova-compute[75469]:       <nova:owner>
Nov 14 05:05:26 user nova-compute[75469]:         <nova:user uuid="aee00a8861b64c90aef13e13ca17b8d0">tempest-TestStampPattern-1299350604-project-member</nova:user>
Nov 14 05:05:26 user nova-compute[75469]:         <nova:project uuid="a227a14762d241479644c6bfdf340bee">tempest-TestStampPattern-1299350604</nova:project>
Nov 14 05:05:26 user nova-compute[75469]:       </nova:owner>
Nov 14 05:05:26 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:05:26 user nova-compute[75469]:       <nova:ports>
Nov 14 05:05:26 user nova-compute[75469]:         <nova:port uuid="e410b203-a06b-4d47-b021-cd273d307573">
Nov 14 05:05:26 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 05:05:26 user nova-compute[75469]:         </nova:port>
Nov 14 05:05:26 user nova-compute[75469]:       </nova:ports>
Nov 14 05:05:26 user nova-compute[75469]:     </nova:instance>
Nov 14 05:05:26 user nova-compute[75469]:   </metadata>
Nov 14 05:05:26 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:05:26 user nova-compute[75469]:     <system>
Nov 14 05:05:26 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:05:26 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:05:26 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:05:26 user nova-compute[75469]:       <entry name="serial">87874095-a320-4445-8dd3-b7b259764dfa</entry>
Nov 14 05:05:26 user nova-compute[75469]:       <entry name="uuid">87874095-a320-4445-8dd3-b7b259764dfa</entry>
Nov 14 05:05:26 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:05:26 user nova-compute[75469]:     </system>
Nov 14 05:05:26 user nova-compute[75469]:   </sysinfo>
Nov 14 05:05:26 user nova-compute[75469]:   <os>
Nov 14 05:05:26 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:05:26 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:05:26 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:05:26 user nova-compute[75469]:   </os>
Nov 14 05:05:26 user nova-compute[75469]:   <features>
Nov 14 05:05:26 user nova-compute[75469]:     <acpi/>
Nov 14 05:05:26 user nova-compute[75469]:     <apic/>
Nov 14 05:05:26 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:05:26 user nova-compute[75469]:   </features>
Nov 14 05:05:26 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:05:26 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:05:26 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:05:26 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:05:26 user nova-compute[75469]:   </clock>
Nov 14 05:05:26 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:05:26 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:05:26 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:05:26 user nova-compute[75469]:   </cpu>
Nov 14 05:05:26 user nova-compute[75469]:   <devices>
Nov 14 05:05:26 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:05:26 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:05:26 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk"/>
Nov 14 05:05:26 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:05:26 user nova-compute[75469]:     </disk>
Nov 14 05:05:26 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:05:26 user nova-compute[75469]:       <mac address="fa:16:3e:6f:cf:ad"/>
Nov 14 05:05:26 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:05:26 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:05:26 user nova-compute[75469]:       <target dev="tape410b203-a0"/>
Nov 14 05:05:26 user nova-compute[75469]:     </interface>
Nov 14 05:05:26 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:05:26 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/console.log" append="off"/>
Nov 14 05:05:26 user nova-compute[75469]:     </serial>
Nov 14 05:05:26 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:05:26 user nova-compute[75469]:     <video>
Nov 14 05:05:26 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:05:26 user nova-compute[75469]:     </video>
Nov 14 05:05:26 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:05:26 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:05:26 user nova-compute[75469]:     </rng>
Nov 14 05:05:26 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:05:26 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:05:26 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:05:26 user nova-compute[75469]:     </memballoon>
Nov 14 05:05:26 user nova-compute[75469]:   </devices>
Nov 14 05:05:26 user nova-compute[75469]: </domain>
Nov 14 05:05:26 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-610960302',display_name='tempest-TestStampPattern-server-610960302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-610960302',id=33,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIbprXKukdzTIGKQy5CdrYJsNjT3KMcr1m2DCPZxsN4W045qdvgMW40zZ6YaNfSahpFUhbzXXXrWBXhMt7BGmhkttHYyfVM1bsmzIIYbrZC/EfH3ShlUu1reGi0vZx7ZQ==',key_name='tempest-TestStampPattern-1132364811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a227a14762d241479644c6bfdf340bee',ramdisk_id='',reservation_id='r-1dh873ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1299350604',owner_user_name='tempest-TestStampPattern-1299350604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:05:25Z,user_data=None,user_id='aee00a8861b64c90aef13e13ca17b8d0',uuid=87874095-a320-4445-8dd3-b7b259764dfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converting VIF {"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=e410b203-a06b-4d47-b021-cd273d307573,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape410b203-a0') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG os_vif [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=e410b203-a06b-4d47-b021-cd273d307573,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape410b203-a0') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '156d0134-4c8e-56d5-9e55-9c04616eb225', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape410b203-a0, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape410b203-a0, col_values=(('qos', UUID('7074e6ed-2d0b-4372-b673-16a737b72330')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape410b203-a0, col_values=(('external_ids', {'iface-id': 'e410b203-a06b-4d47-b021-cd273d307573', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:cf:ad', 'vm-uuid': '87874095-a320-4445-8dd3-b7b259764dfa'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:26 user nova-compute[75469]: INFO os_vif [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=e410b203-a06b-4d47-b021-cd273d307573,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape410b203-a0')
Nov 14 05:05:26 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a8350c59-92c2-4348-bea4-482079ec0f5a is timed out.
Nov 14 05:05:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully detached device vdc from instance a8350c59-92c2-4348-bea4-482079ec0f5a from the live domain config.
Nov 14 05:05:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'axHUtyBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:05:26 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:05:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa19634-bec3-419f-89a5-5ac8fd2089fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:05:26 user nova-compute[75469]: No targets found.
Nov 14 05:05:26 user nova-compute[75469]: iSNS:
Nov 14 05:05:26 user nova-compute[75469]: No targets found.
Nov 14 05:05:26 user nova-compute[75469]: STATIC:
Nov 14 05:05:26 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b
Nov 14 05:05:26 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:26 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:26 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5
Nov 14 05:05:26 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:26 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:26 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:05:26 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:05:26 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:05:26 user nova-compute[75469]: FIRMWARE:
Nov 14 05:05:26 user nova-compute[75469]: No targets found.
Nov 14 05:05:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:05:26 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:05:26 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:05:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] No VIF found with MAC fa:16:3e:6f:cf:ad, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07e2dae-8034-4fc9-9195-85d85922c545]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07c8588-efab-4256-bdb8-2fc208c527c6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:05:27 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:05:27 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:05:27 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:05:27 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:05:27 user nova-compute[75469]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b (non-flash)
Nov 14 05:05:27 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c2964d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b'): ({'sdg'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Removing single pathed devices sdg {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f795872-7770-479e-8824-aacc4761c0e0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c324de93-375a-4200-a020-e974e687ab27]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Flushing IO for device /dev/sdg {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b3ae25-0b0a-4ffa-abfc-b65beb47ba35]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8cd963-3af8-4938-849d-8c1aa3e0d60b]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] SCSI volumes sdg have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1ffb27-b374-495f-b2de-20f109402512]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ddddac-408e-43d3-9679-0e8dda931c41]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b, portal: 172.16.0.220,3260]
Nov 14 05:05:27 user nova-compute[75469]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b, portal: 172.16.0.220,3260] successful.
Nov 14 05:05:27 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2baab7f-5cfb-413b-9006-1ac2f592ef0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe1d8be-53e8-43bc-ab5d-695894094192]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] <== disconnect_volume: return (335ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-1a54ae7f-f1c4-46d4-aabb-1b38149e5e23 req-11ba535b-4e78-4a10-b313-a19e6665a0ef service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Updated VIF entry in instance network info cache for port e410b203-a06b-4d47-b021-cd273d307573. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-1a54ae7f-f1c4-46d4-aabb-1b38149e5e23 req-11ba535b-4e78-4a10-b313-a19e6665a0ef service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Updating instance_info_cache with network_info: [{"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:05:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1a54ae7f-f1c4-46d4-aabb-1b38149e5e23 req-11ba535b-4e78-4a10-b313-a19e6665a0ef service nova] Releasing lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:05:28 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'flavor' on Instance uuid a8350c59-92c2-4348-bea4-482079ec0f5a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e6436133-1be3-45a4-aa8b-c8f0ef77e443 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.725s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:28 user nova-compute[75469]: DEBUG nova.compute.manager [req-d8f07fce-ce11-4ea0-8dc9-c042a8af4deb req-9ec91baf-ecdf-4fc4-861a-07a4019ee0b0 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received event network-vif-plugged-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d8f07fce-ce11-4ea0-8dc9-c042a8af4deb req-9ec91baf-ecdf-4fc4-861a-07a4019ee0b0 service nova] Acquiring lock "87874095-a320-4445-8dd3-b7b259764dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d8f07fce-ce11-4ea0-8dc9-c042a8af4deb req-9ec91baf-ecdf-4fc4-861a-07a4019ee0b0 service nova] Lock "87874095-a320-4445-8dd3-b7b259764dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d8f07fce-ce11-4ea0-8dc9-c042a8af4deb req-9ec91baf-ecdf-4fc4-861a-07a4019ee0b0 service nova] Lock "87874095-a320-4445-8dd3-b7b259764dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:28 user nova-compute[75469]: DEBUG nova.compute.manager [req-d8f07fce-ce11-4ea0-8dc9-c042a8af4deb req-9ec91baf-ecdf-4fc4-861a-07a4019ee0b0 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] No waiting events found dispatching network-vif-plugged-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:28 user nova-compute[75469]: WARNING nova.compute.manager [req-d8f07fce-ce11-4ea0-8dc9-c042a8af4deb req-9ec91baf-ecdf-4fc4-861a-07a4019ee0b0 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received unexpected event network-vif-plugged-e410b203-a06b-4d47-b021-cd273d307573 for instance with vm_state building and task_state spawning.
Nov 14 05:05:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:29 user nova-compute[75469]: INFO nova.compute.manager [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Terminating instance
Nov 14 05:05:29 user nova-compute[75469]: DEBUG nova.compute.manager [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:05:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Instance destroyed successfully.
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.objects.instance [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lazy-loading 'resources' on Instance uuid a8350c59-92c2-4348-bea4-482079ec0f5a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047052642',display_name='tempest-AttachVolumeTestJSON-server-2047052642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047052642',id=29,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4LWOIU63vNi3HIGchdoFmGy72dIFXiEFAZdK8fh4yC3Y82tI2drCcxTacLVm1WX0f80bxjwyfJQ1Y78YwNTyK6PUAPorRO+vs3G3brS7kYqLxJqIdi3Gm61H9S/zO2Zg==',key_name='tempest-keypair-1109306906',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7e85721ebed4cccaecde59d1944cd64',ramdisk_id='',reservation_id='r-g8s038zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2079958443',owner_user_name='tempest-AttachVolumeTestJSON-2079958443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3142f0a24ee841878d06e14817fa1f86',uuid=a8350c59-92c2-4348-bea4-482079ec0f5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "472a1743-c919-4b69-aa32-7cebc40c439e", "address": "fa:16:3e:b4:92:5f", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472a1743-c9", "ovs_interfaceid": "472a1743-c919-4b69-aa32-7cebc40c439e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converting VIF {"id": "472a1743-c919-4b69-aa32-7cebc40c439e", "address": "fa:16:3e:b4:92:5f", "network": {"id": "af573171-34b8-452b-a29d-ae82f9441a89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-235597378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7e85721ebed4cccaecde59d1944cd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472a1743-c9", "ovs_interfaceid": "472a1743-c919-4b69-aa32-7cebc40c439e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:92:5f,bridge_name='br-int',has_traffic_filtering=True,id=472a1743-c919-4b69-aa32-7cebc40c439e,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472a1743-c9') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG os_vif [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:92:5f,bridge_name='br-int',has_traffic_filtering=True,id=472a1743-c919-4b69-aa32-7cebc40c439e,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472a1743-c9') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap472a1743-c9, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9f96793-76db-41bf-b7af-16052ed30f7a) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:05:30 user nova-compute[75469]: INFO os_vif [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:92:5f,bridge_name='br-int',has_traffic_filtering=True,id=472a1743-c919-4b69-aa32-7cebc40c439e,network=Network(af573171-34b8-452b-a29d-ae82f9441a89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472a1743-c9')
Nov 14 05:05:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Deleting instance files /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a_del
Nov 14 05:05:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Deletion of /opt/stack/data/nova/instances/a8350c59-92c2-4348-bea4-482079ec0f5a_del complete
Nov 14 05:05:30 user nova-compute[75469]: INFO nova.compute.manager [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 05:05:30 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received event network-vif-plugged-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] Acquiring lock "87874095-a320-4445-8dd3-b7b259764dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] Lock "87874095-a320-4445-8dd3-b7b259764dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] Lock "87874095-a320-4445-8dd3-b7b259764dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] No waiting events found dispatching network-vif-plugged-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:30 user nova-compute[75469]: WARNING nova.compute.manager [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received unexpected event network-vif-plugged-e410b203-a06b-4d47-b021-cd273d307573 for instance with vm_state building and task_state spawning.
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Received event network-vif-unplugged-472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] No waiting events found dispatching network-vif-unplugged-472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Received event network-vif-unplugged-472a1743-c919-4b69-aa32-7cebc40c439e for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Received event network-vif-plugged-472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] Acquiring lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] No waiting events found dispatching network-vif-plugged-472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:05:30 user nova-compute[75469]: WARNING nova.compute.manager [req-c4e1a1e4-bc5d-496a-8aa6-47cd4b678539 req-e98a8906-c5a5-492b-9f06-0d462d47f685 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Received unexpected event network-vif-plugged-472a1743-c919-4b69-aa32-7cebc40c439e for instance with vm_state active and task_state deleting.
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:05:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Instance spawned successfully.
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:05:30 user nova-compute[75469]: INFO nova.compute.manager [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 14 05:05:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:05:30 user nova-compute[75469]: INFO nova.compute.manager [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Took 6.82 seconds to build instance.
Nov 14 05:05:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-800718d1-d6ee-4794-bcd3-abe4ea707314 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.921s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:31 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:05:31 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Took 0.90 seconds to deallocate network for instance.
Nov 14 05:05:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-07b17eba-40f3-44a6-a5cb-d1edeb1cb894 req-046abd17-d639-4c2a-ab0f-913fb8e87486 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Received event network-vif-deleted-472a1743-c919-4b69-aa32-7cebc40c439e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:05:31 user nova-compute[75469]: INFO nova.compute.manager [req-07b17eba-40f3-44a6-a5cb-d1edeb1cb894 req-046abd17-d639-4c2a-ab0f-913fb8e87486 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Neutron deleted interface 472a1743-c919-4b69-aa32-7cebc40c439e; detaching it from the instance and deleting it from the info cache
Nov 14 05:05:31 user nova-compute[75469]: DEBUG nova.network.neutron [req-07b17eba-40f3-44a6-a5cb-d1edeb1cb894 req-046abd17-d639-4c2a-ab0f-913fb8e87486 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:05:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-07b17eba-40f3-44a6-a5cb-d1edeb1cb894 req-046abd17-d639-4c2a-ab0f-913fb8e87486 service nova] [instance: a8350c59-92c2-4348-bea4-482079ec0f5a] Detach interface failed, port_id=472a1743-c919-4b69-aa32-7cebc40c439e, reason: Instance a8350c59-92c2-4348-bea4-482079ec0f5a could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:05:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:31 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:05:31 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:05:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:31 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Deleted allocations for instance a8350c59-92c2-4348-bea4-482079ec0f5a
Nov 14 05:05:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-05a3933c-438f-40e6-ab38-9e468256ed61 tempest-AttachVolumeTestJSON-2079958443 tempest-AttachVolumeTestJSON-2079958443-project-member] Lock "a8350c59-92c2-4348-bea4-482079ec0f5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.297s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:05:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:05:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:05:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:05:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:05:51 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:05:51 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 80741f98-11b9-4a80-a51b-39d5ce4e44f5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:05:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:51 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updating instance_info_cache with network_info: [{"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:05:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:05:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:05:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:05:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:05:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:05:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:05:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:05:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7929MB free_disk=24.876819610595703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a48d1c5d-db49-4609-9ca4-21f4578d8943 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c07c6b3f-e748-4a36-a018-2336000b716d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c8335ffd-314e-43f1-9573-200556415a14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 87874095-a320-4445-8dd3-b7b259764dfa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:05:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:05:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:05:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:05:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:05:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:05:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:05:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:05:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:05:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:06:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:01 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:06:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:03 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:06:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:03 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:06:03 user nova-compute[75469]: INFO nova.compute.claims [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Claim successful on node user
Nov 14 05:06:04 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:06:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:06:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG nova.policy [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0155ca3745514d6c8c0ab08a9182df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf022cc839af44ff89e4249410c4a9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:06:04 user nova-compute[75469]: INFO nova.virt.block_device [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Booting with volume d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a at /dev/vda
Nov 14 05:06:04 user nova-compute[75469]: DEBUG os_brick.utils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bee3f4-43b3-47f3-a26a-4a5b168156cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d0c462-40aa-473b-a9e0-fa644954f800]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5dd9cb-b2ba-4a2f-aaf1-19ba53519c0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3bbb12-4cb3-4122-9823-d886f3f15c3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:06:04 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:06:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3c8289-79bf-45e1-911e-1cb910e9c1a0]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG os_brick.utils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:06:04 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Updating existing volume attachment record: 93b2bb15-5194-4069-a3c1-26408d1de275 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:06:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Successfully created port: 213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:06:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Successfully updated port: 213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:06:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "refresh_cache-9a0c1e54-59d5-4890-9c6c-3bc34928bb65" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:06:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquired lock "refresh_cache-9a0c1e54-59d5-4890-9c6c-3bc34928bb65" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:06:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:06:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-d36e099b-9d94-4131-99d0-7f9eb90d3077 req-a0c46dcf-fea6-4b98-8e17-a77a70b31c7b service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Received event network-changed-213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-d36e099b-9d94-4131-99d0-7f9eb90d3077 req-a0c46dcf-fea6-4b98-8e17-a77a70b31c7b service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Refreshing instance network info cache due to event network-changed-213df0cd-0a8b-4c7d-a71c-4210adbadf4d. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:06:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d36e099b-9d94-4131-99d0-7f9eb90d3077 req-a0c46dcf-fea6-4b98-8e17-a77a70b31c7b service nova] Acquiring lock "refresh_cache-9a0c1e54-59d5-4890-9c6c-3bc34928bb65" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:06:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:06:06 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Updating instance_info_cache with network_info: [{"id": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "address": "fa:16:3e:c4:7a:7d", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213df0cd-0a", "ovs_interfaceid": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:06:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Releasing lock "refresh_cache-9a0c1e54-59d5-4890-9c6c-3bc34928bb65" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:06:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Instance network_info: |[{"id": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "address": "fa:16:3e:c4:7a:7d", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213df0cd-0a", "ovs_interfaceid": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:06:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d36e099b-9d94-4131-99d0-7f9eb90d3077 req-a0c46dcf-fea6-4b98-8e17-a77a70b31c7b service nova] Acquired lock "refresh_cache-9a0c1e54-59d5-4890-9c6c-3bc34928bb65" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:06:06 user nova-compute[75469]: DEBUG nova.network.neutron [req-d36e099b-9d94-4131-99d0-7f9eb90d3077 req-a0c46dcf-fea6-4b98-8e17-a77a70b31c7b service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Refreshing network info cache for port 213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:06:06 user nova-compute[75469]: DEBUG nova.network.neutron [req-d36e099b-9d94-4131-99d0-7f9eb90d3077 req-a0c46dcf-fea6-4b98-8e17-a77a70b31c7b service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Updated VIF entry in instance network info cache for port 213df0cd-0a8b-4c7d-a71c-4210adbadf4d. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:06:06 user nova-compute[75469]: DEBUG nova.network.neutron [req-d36e099b-9d94-4131-99d0-7f9eb90d3077 req-a0c46dcf-fea6-4b98-8e17-a77a70b31c7b service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Updating instance_info_cache with network_info: [{"id": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "address": "fa:16:3e:c4:7a:7d", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213df0cd-0a", "ovs_interfaceid": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:06:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d36e099b-9d94-4131-99d0-7f9eb90d3077 req-a0c46dcf-fea6-4b98-8e17-a77a70b31c7b service nova] Releasing lock "refresh_cache-9a0c1e54-59d5-4890-9c6c-3bc34928bb65" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:06:09 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Creating image(s)
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Ensure instance console log exists: /opt/stack/data/nova/instances/9a0c1e54-59d5-4890-9c6c-3bc34928bb65/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Start _get_guest_xml network_info=[{"id": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "address": "fa:16:3e:c4:7a:7d", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213df0cd-0a", "ovs_interfaceid": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '93b2bb15-5194-4069-a3c1-26408d1de275', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoiGRWwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a0c1e54-59d5-4890-9c6c-3bc34928bb65', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9a19fa4-0ebe-49bd-8aad-7a6b47f2411a', 'serial': 'd9a19fa4-0ebe-49bd-8aad-7a6b47f2411a'}, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:06:09 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:06:09 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoiGRWwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:06:09 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:06:09 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:06:09 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[10541641-12a9-4cf8-a501-441591182dc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:06:09 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f832016a-4d2c-4dd8-8cf9-942f2e8c69fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a] added
Nov 14 05:06:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5303d86e-f0b3-4ba0-aefc-52f7dfaf2b4e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d20213-d761-43b9-a6f5-c7e32e788a5c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hoiGRWwl {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hoiGRWwl" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7f9151-73a0-4cb9-865a-2202a802d21f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hoiGRWwl'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77966f67-605f-4017-8ddd-ffa7cc5bcc8d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb243164-9114-4092-84c4-53c6a8af5116]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:06:09 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:06:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:06:09 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:06:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d261ce-3706-4ec2-8c18-632d91099a5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a, portal: 172.16.0.220,3260]
Nov 14 05:06:09 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a, portal: 172.16.0.220,3260] successful.
Nov 14 05:06:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ece756-07fd-4e97-aef9-37c768a2da70]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eb0203-0366-4fcb-8aaf-76ad74ca66f4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:06:09 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:06:09 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:06:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:06:09 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:06:09 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:06:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7419de-eee3-41dc-8071-1b45914204aa]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:06:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoiGRWwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23936383861366438', 'path': '/dev/sdd'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936383861366438', 'path': '/dev/sdd'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-112432102',display_name='tempest-TestVolumeBootPattern-volume-backed-server-112432102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-112432102',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsOA22kp3VaILaqFcHCVLm/S/NGmhpZLIwmk447Hs5IPUmL90u38jvH9MxCNf1cbYUHzOLezhyIc/uIwHghJkR7v4keNMW+QRRlBCFuvke4SBrY198sz2IudzNTdk0D+Q==',key_name='tempest-keypair-770505458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-xwabq7z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:06:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=9a0c1e54-59d5-4890-9c6c-3bc34928bb65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "address": "fa:16:3e:c4:7a:7d", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213df0cd-0a", "ovs_interfaceid": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "address": "fa:16:3e:c4:7a:7d", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213df0cd-0a", "ovs_interfaceid": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7a:7d,bridge_name='br-int',has_traffic_filtering=True,id=213df0cd-0a8b-4c7d-a71c-4210adbadf4d,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213df0cd-0a') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a0c1e54-59d5-4890-9c6c-3bc34928bb65 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:06:10 user nova-compute[75469]:   <uuid>9a0c1e54-59d5-4890-9c6c-3bc34928bb65</uuid>
Nov 14 05:06:10 user nova-compute[75469]:   <name>instance-00000022</name>
Nov 14 05:06:10 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:06:10 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:06:10 user nova-compute[75469]:   <metadata>
Nov 14 05:06:10 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:06:10 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:06:10 user nova-compute[75469]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-112432102</nova:name>
Nov 14 05:06:10 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:06:09</nova:creationTime>
Nov 14 05:06:10 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:06:10 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:06:10 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:06:10 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:06:10 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:06:10 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:06:10 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:06:10 user nova-compute[75469]:       <nova:owner>
Nov 14 05:06:10 user nova-compute[75469]:         <nova:user uuid="0155ca3745514d6c8c0ab08a9182df53">tempest-TestVolumeBootPattern-43343925-project-member</nova:user>
Nov 14 05:06:10 user nova-compute[75469]:         <nova:project uuid="bf022cc839af44ff89e4249410c4a9e4">tempest-TestVolumeBootPattern-43343925</nova:project>
Nov 14 05:06:10 user nova-compute[75469]:       </nova:owner>
Nov 14 05:06:10 user nova-compute[75469]:       <nova:ports>
Nov 14 05:06:10 user nova-compute[75469]:         <nova:port uuid="213df0cd-0a8b-4c7d-a71c-4210adbadf4d">
Nov 14 05:06:10 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 05:06:10 user nova-compute[75469]:         </nova:port>
Nov 14 05:06:10 user nova-compute[75469]:       </nova:ports>
Nov 14 05:06:10 user nova-compute[75469]:     </nova:instance>
Nov 14 05:06:10 user nova-compute[75469]:   </metadata>
Nov 14 05:06:10 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:06:10 user nova-compute[75469]:     <system>
Nov 14 05:06:10 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:06:10 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:06:10 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:06:10 user nova-compute[75469]:       <entry name="serial">9a0c1e54-59d5-4890-9c6c-3bc34928bb65</entry>
Nov 14 05:06:10 user nova-compute[75469]:       <entry name="uuid">9a0c1e54-59d5-4890-9c6c-3bc34928bb65</entry>
Nov 14 05:06:10 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:06:10 user nova-compute[75469]:     </system>
Nov 14 05:06:10 user nova-compute[75469]:   </sysinfo>
Nov 14 05:06:10 user nova-compute[75469]:   <os>
Nov 14 05:06:10 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:06:10 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:06:10 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:06:10 user nova-compute[75469]:   </os>
Nov 14 05:06:10 user nova-compute[75469]:   <features>
Nov 14 05:06:10 user nova-compute[75469]:     <acpi/>
Nov 14 05:06:10 user nova-compute[75469]:     <apic/>
Nov 14 05:06:10 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:06:10 user nova-compute[75469]:   </features>
Nov 14 05:06:10 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:06:10 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:06:10 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:06:10 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:06:10 user nova-compute[75469]:   </clock>
Nov 14 05:06:10 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:06:10 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:06:10 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:06:10 user nova-compute[75469]:   </cpu>
Nov 14 05:06:10 user nova-compute[75469]:   <devices>
Nov 14 05:06:10 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:06:10 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:06:10 user nova-compute[75469]:       <source dev="/dev/sdd"/>
Nov 14 05:06:10 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:06:10 user nova-compute[75469]:       <serial>d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a</serial>
Nov 14 05:06:10 user nova-compute[75469]:     </disk>
Nov 14 05:06:10 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:06:10 user nova-compute[75469]:       <mac address="fa:16:3e:c4:7a:7d"/>
Nov 14 05:06:10 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:06:10 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:06:10 user nova-compute[75469]:       <target dev="tap213df0cd-0a"/>
Nov 14 05:06:10 user nova-compute[75469]:     </interface>
Nov 14 05:06:10 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:06:10 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/9a0c1e54-59d5-4890-9c6c-3bc34928bb65/console.log" append="off"/>
Nov 14 05:06:10 user nova-compute[75469]:     </serial>
Nov 14 05:06:10 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:06:10 user nova-compute[75469]:     <video>
Nov 14 05:06:10 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:06:10 user nova-compute[75469]:     </video>
Nov 14 05:06:10 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:06:10 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:06:10 user nova-compute[75469]:     </rng>
Nov 14 05:06:10 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:06:10 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:06:10 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:06:10 user nova-compute[75469]:     </memballoon>
Nov 14 05:06:10 user nova-compute[75469]:   </devices>
Nov 14 05:06:10 user nova-compute[75469]: </domain>
Nov 14 05:06:10 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-112432102',display_name='tempest-TestVolumeBootPattern-volume-backed-server-112432102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-112432102',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsOA22kp3VaILaqFcHCVLm/S/NGmhpZLIwmk447Hs5IPUmL90u38jvH9MxCNf1cbYUHzOLezhyIc/uIwHghJkR7v4keNMW+QRRlBCFuvke4SBrY198sz2IudzNTdk0D+Q==',key_name='tempest-keypair-770505458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-xwabq7z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:06:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=9a0c1e54-59d5-4890-9c6c-3bc34928bb65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "address": "fa:16:3e:c4:7a:7d", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213df0cd-0a", "ovs_interfaceid": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "address": "fa:16:3e:c4:7a:7d", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213df0cd-0a", "ovs_interfaceid": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7a:7d,bridge_name='br-int',has_traffic_filtering=True,id=213df0cd-0a8b-4c7d-a71c-4210adbadf4d,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213df0cd-0a') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG os_vif [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7a:7d,bridge_name='br-int',has_traffic_filtering=True,id=213df0cd-0a8b-4c7d-a71c-4210adbadf4d,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213df0cd-0a') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cd30554-af66-502a-810f-2d2497dd80cf', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap213df0cd-0a, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap213df0cd-0a, col_values=(('qos', UUID('89e7ecaf-004c-4d1b-bf06-4d4c61eca0f7')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap213df0cd-0a, col_values=(('external_ids', {'iface-id': '213df0cd-0a8b-4c7d-a71c-4210adbadf4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:7a:7d', 'vm-uuid': '9a0c1e54-59d5-4890-9c6c-3bc34928bb65'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:10 user nova-compute[75469]: INFO os_vif [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7a:7d,bridge_name='br-int',has_traffic_filtering=True,id=213df0cd-0a8b-4c7d-a71c-4210adbadf4d,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213df0cd-0a')
Nov 14 05:06:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:06:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No VIF found with MAC fa:16:3e:c4:7a:7d, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:06:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-4f7753f8-e39e-4aac-a1d2-5c2914a0dec9 req-3dbc3484-91bf-4bf5-a21a-0716b9a1fd32 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Received event network-vif-plugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4f7753f8-e39e-4aac-a1d2-5c2914a0dec9 req-3dbc3484-91bf-4bf5-a21a-0716b9a1fd32 service nova] Acquiring lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4f7753f8-e39e-4aac-a1d2-5c2914a0dec9 req-3dbc3484-91bf-4bf5-a21a-0716b9a1fd32 service nova] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4f7753f8-e39e-4aac-a1d2-5c2914a0dec9 req-3dbc3484-91bf-4bf5-a21a-0716b9a1fd32 service nova] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-4f7753f8-e39e-4aac-a1d2-5c2914a0dec9 req-3dbc3484-91bf-4bf5-a21a-0716b9a1fd32 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] No waiting events found dispatching network-vif-plugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:06:12 user nova-compute[75469]: WARNING nova.compute.manager [req-4f7753f8-e39e-4aac-a1d2-5c2914a0dec9 req-3dbc3484-91bf-4bf5-a21a-0716b9a1fd32 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Received unexpected event network-vif-plugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d for instance with vm_state building and task_state spawning.
Nov 14 05:06:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:12 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:06:13 user nova-compute[75469]: INFO nova.compute.claims [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Claim successful on node user
Nov 14 05:06:13 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:06:13 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:06:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:06:13 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Creating image(s)
Nov 14 05:06:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "/opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "/opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG nova.policy [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fedd54c65b8a4adbba761994474cdd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac925f78df5d4746a9bd603db3613839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:14 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Instance spawned successfully.
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-1fc196c4-b1f6-427c-aa9e-80ab21f66224 req-6fbdb664-244e-4ced-9b75-0e588ea5c3c7 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Received event network-vif-plugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1fc196c4-b1f6-427c-aa9e-80ab21f66224 req-6fbdb664-244e-4ced-9b75-0e588ea5c3c7 service nova] Acquiring lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1fc196c4-b1f6-427c-aa9e-80ab21f66224 req-6fbdb664-244e-4ced-9b75-0e588ea5c3c7 service nova] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1fc196c4-b1f6-427c-aa9e-80ab21f66224 req-6fbdb664-244e-4ced-9b75-0e588ea5c3c7 service nova] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-1fc196c4-b1f6-427c-aa9e-80ab21f66224 req-6fbdb664-244e-4ced-9b75-0e588ea5c3c7 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] No waiting events found dispatching network-vif-plugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:06:14 user nova-compute[75469]: WARNING nova.compute.manager [req-1fc196c4-b1f6-427c-aa9e-80ab21f66224 req-6fbdb664-244e-4ced-9b75-0e588ea5c3c7 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Received unexpected event network-vif-plugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d for instance with vm_state building and task_state spawning.
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk 1073741824" returned: 0 in 0.073s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:14 user nova-compute[75469]: INFO nova.compute.manager [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.217s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:14 user nova-compute[75469]: INFO nova.compute.manager [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Took 10.69 seconds to build instance.
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4f9571c8-df20-4593-bd82-ce076fda2b92 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.813s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Cannot resize image /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Ensure instance console log exists: /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:15 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Successfully created port: 5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:06:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:15 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Successfully updated port: 5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:06:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "refresh_cache-a8ffecbb-5de1-4425-adc5-77fab650b8bf" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:06:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquired lock "refresh_cache-a8ffecbb-5de1-4425-adc5-77fab650b8bf" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:06:15 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:06:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-28079fad-40b8-4f47-846c-4316f69e2835 req-32b161f5-9c96-473b-a223-f3e28b5a3a8e service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-changed-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-28079fad-40b8-4f47-846c-4316f69e2835 req-32b161f5-9c96-473b-a223-f3e28b5a3a8e service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Refreshing instance network info cache due to event network-changed-5b19d7a7-df11-4a7b-b994-e62b40a91600. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:06:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-28079fad-40b8-4f47-846c-4316f69e2835 req-32b161f5-9c96-473b-a223-f3e28b5a3a8e service nova] Acquiring lock "refresh_cache-a8ffecbb-5de1-4425-adc5-77fab650b8bf" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:06:15 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Updating instance_info_cache with network_info: [{"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Releasing lock "refresh_cache-a8ffecbb-5de1-4425-adc5-77fab650b8bf" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Instance network_info: |[{"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-28079fad-40b8-4f47-846c-4316f69e2835 req-32b161f5-9c96-473b-a223-f3e28b5a3a8e service nova] Acquired lock "refresh_cache-a8ffecbb-5de1-4425-adc5-77fab650b8bf" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.network.neutron [req-28079fad-40b8-4f47-846c-4316f69e2835 req-32b161f5-9c96-473b-a223-f3e28b5a3a8e service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Refreshing network info cache for port 5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Start _get_guest_xml network_info=[{"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:06:16 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:06:16 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-371085368',display_name='tempest-tempest.common.compute-instance-371085368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-371085368',id=35,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEGTjKqJtkw69dGeCfipwwu89LWWzigSdhele3X3LHWVxYIXIwfNlKlD+XZzmRdKkrwU9RQT/IBBp6eeTDS+MZRGWNM5TH35v1mw59FjYgHxSYncm9QShDeNALd4AjFug==',key_name='tempest-keypair-1304959429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-s900r63d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a8ffecbb-5de1-4425-adc5-77fab650b8bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'pci_devices' on Instance uuid a8ffecbb-5de1-4425-adc5-77fab650b8bf {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:06:16 user nova-compute[75469]:   <uuid>a8ffecbb-5de1-4425-adc5-77fab650b8bf</uuid>
Nov 14 05:06:16 user nova-compute[75469]:   <name>instance-00000023</name>
Nov 14 05:06:16 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:06:16 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:06:16 user nova-compute[75469]:   <metadata>
Nov 14 05:06:16 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:06:16 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:06:16 user nova-compute[75469]:       <nova:name>tempest-tempest.common.compute-instance-371085368</nova:name>
Nov 14 05:06:16 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:06:16</nova:creationTime>
Nov 14 05:06:16 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:06:16 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:06:16 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:06:16 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:06:16 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:06:16 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:06:16 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:06:16 user nova-compute[75469]:       <nova:owner>
Nov 14 05:06:16 user nova-compute[75469]:         <nova:user uuid="fedd54c65b8a4adbba761994474cdd9b">tempest-ServerActionsTestOtherA-2099137527-project-member</nova:user>
Nov 14 05:06:16 user nova-compute[75469]:         <nova:project uuid="ac925f78df5d4746a9bd603db3613839">tempest-ServerActionsTestOtherA-2099137527</nova:project>
Nov 14 05:06:16 user nova-compute[75469]:       </nova:owner>
Nov 14 05:06:16 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:06:16 user nova-compute[75469]:       <nova:ports>
Nov 14 05:06:16 user nova-compute[75469]:         <nova:port uuid="5b19d7a7-df11-4a7b-b994-e62b40a91600">
Nov 14 05:06:16 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 05:06:16 user nova-compute[75469]:         </nova:port>
Nov 14 05:06:16 user nova-compute[75469]:       </nova:ports>
Nov 14 05:06:16 user nova-compute[75469]:     </nova:instance>
Nov 14 05:06:16 user nova-compute[75469]:   </metadata>
Nov 14 05:06:16 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:06:16 user nova-compute[75469]:     <system>
Nov 14 05:06:16 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:06:16 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:06:16 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:06:16 user nova-compute[75469]:       <entry name="serial">a8ffecbb-5de1-4425-adc5-77fab650b8bf</entry>
Nov 14 05:06:16 user nova-compute[75469]:       <entry name="uuid">a8ffecbb-5de1-4425-adc5-77fab650b8bf</entry>
Nov 14 05:06:16 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:06:16 user nova-compute[75469]:     </system>
Nov 14 05:06:16 user nova-compute[75469]:   </sysinfo>
Nov 14 05:06:16 user nova-compute[75469]:   <os>
Nov 14 05:06:16 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:06:16 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:06:16 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:06:16 user nova-compute[75469]:   </os>
Nov 14 05:06:16 user nova-compute[75469]:   <features>
Nov 14 05:06:16 user nova-compute[75469]:     <acpi/>
Nov 14 05:06:16 user nova-compute[75469]:     <apic/>
Nov 14 05:06:16 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:06:16 user nova-compute[75469]:   </features>
Nov 14 05:06:16 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:06:16 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:06:16 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:06:16 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:06:16 user nova-compute[75469]:   </clock>
Nov 14 05:06:16 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:06:16 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:06:16 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:06:16 user nova-compute[75469]:   </cpu>
Nov 14 05:06:16 user nova-compute[75469]:   <devices>
Nov 14 05:06:16 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:06:16 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:06:16 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk"/>
Nov 14 05:06:16 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:06:16 user nova-compute[75469]:     </disk>
Nov 14 05:06:16 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:06:16 user nova-compute[75469]:       <mac address="fa:16:3e:c5:30:3f"/>
Nov 14 05:06:16 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:06:16 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:06:16 user nova-compute[75469]:       <target dev="tap5b19d7a7-df"/>
Nov 14 05:06:16 user nova-compute[75469]:     </interface>
Nov 14 05:06:16 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:06:16 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/console.log" append="off"/>
Nov 14 05:06:16 user nova-compute[75469]:     </serial>
Nov 14 05:06:16 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:06:16 user nova-compute[75469]:     <video>
Nov 14 05:06:16 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:06:16 user nova-compute[75469]:     </video>
Nov 14 05:06:16 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:06:16 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:06:16 user nova-compute[75469]:     </rng>
Nov 14 05:06:16 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:06:16 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:06:16 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:06:16 user nova-compute[75469]:     </memballoon>
Nov 14 05:06:16 user nova-compute[75469]:   </devices>
Nov 14 05:06:16 user nova-compute[75469]: </domain>
Nov 14 05:06:16 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-371085368',display_name='tempest-tempest.common.compute-instance-371085368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-371085368',id=35,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEGTjKqJtkw69dGeCfipwwu89LWWzigSdhele3X3LHWVxYIXIwfNlKlD+XZzmRdKkrwU9RQT/IBBp6eeTDS+MZRGWNM5TH35v1mw59FjYgHxSYncm9QShDeNALd4AjFug==',key_name='tempest-keypair-1304959429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-s900r63d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a8ffecbb-5de1-4425-adc5-77fab650b8bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG os_vif [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3469cdd2-7268-5ff9-823c-96b5f8987cb1', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b19d7a7-df, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b19d7a7-df, col_values=(('qos', UUID('10c55498-2c08-4a77-930f-3c049dbbf201')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b19d7a7-df, col_values=(('external_ids', {'iface-id': '5b19d7a7-df11-4a7b-b994-e62b40a91600', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:30:3f', 'vm-uuid': 'a8ffecbb-5de1-4425-adc5-77fab650b8bf'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:16 user nova-compute[75469]: INFO os_vif [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df')
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No VIF found with MAC fa:16:3e:c5:30:3f, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.network.neutron [req-28079fad-40b8-4f47-846c-4316f69e2835 req-32b161f5-9c96-473b-a223-f3e28b5a3a8e service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Updated VIF entry in instance network info cache for port 5b19d7a7-df11-4a7b-b994-e62b40a91600. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.network.neutron [req-28079fad-40b8-4f47-846c-4316f69e2835 req-32b161f5-9c96-473b-a223-f3e28b5a3a8e service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Updating instance_info_cache with network_info: [{"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-28079fad-40b8-4f47-846c-4316f69e2835 req-32b161f5-9c96-473b-a223-f3e28b5a3a8e service nova] Releasing lock "refresh_cache-a8ffecbb-5de1-4425-adc5-77fab650b8bf" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "48eb80db-7b57-42cf-9555-41909fd0c59f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:16 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:06:16 user nova-compute[75469]: INFO nova.compute.claims [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Claim successful on node user
Nov 14 05:06:17 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG nova.network.neutron [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:06:17 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:06:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG nova.policy [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e98acc8e0c8044cca5d6f7a35b3bdad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59f6cc7c2254d4ba2581a445e02075f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:06:17 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Creating image(s)
Nov 14 05:06:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "/opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "/opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "/opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.202s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.211s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-84393ef2-e8cb-4d00-aa19-8cc8460c66fa req-181dd143-b8d1-4af8-a4ff-d2b04a776926 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-84393ef2-e8cb-4d00-aa19-8cc8460c66fa req-181dd143-b8d1-4af8-a4ff-d2b04a776926 service nova] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-84393ef2-e8cb-4d00-aa19-8cc8460c66fa req-181dd143-b8d1-4af8-a4ff-d2b04a776926 service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-84393ef2-e8cb-4d00-aa19-8cc8460c66fa req-181dd143-b8d1-4af8-a4ff-d2b04a776926 service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-84393ef2-e8cb-4d00-aa19-8cc8460c66fa req-181dd143-b8d1-4af8-a4ff-d2b04a776926 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] No waiting events found dispatching network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:06:18 user nova-compute[75469]: WARNING nova.compute.manager [req-84393ef2-e8cb-4d00-aa19-8cc8460c66fa req-181dd143-b8d1-4af8-a4ff-d2b04a776926 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received unexpected event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 for instance with vm_state building and task_state spawning.
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk 1073741824" returned: 0 in 0.067s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.224s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Cannot resize image /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Ensure instance console log exists: /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Successfully created port: 9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Successfully updated port: 9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "refresh_cache-48eb80db-7b57-42cf-9555-41909fd0c59f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquired lock "refresh_cache-48eb80db-7b57-42cf-9555-41909fd0c59f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Updating instance_info_cache with network_info: [{"id": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "address": "fa:16:3e:42:b2:61", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abc82fa-51", "ovs_interfaceid": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Releasing lock "refresh_cache-48eb80db-7b57-42cf-9555-41909fd0c59f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Instance network_info: |[{"id": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "address": "fa:16:3e:42:b2:61", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abc82fa-51", "ovs_interfaceid": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Start _get_guest_xml network_info=[{"id": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "address": "fa:16:3e:42:b2:61", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abc82fa-51", "ovs_interfaceid": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:06:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:06:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1385426198',display_name='tempest-AttachVolumeNegativeTest-server-1385426198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1385426198',id=36,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8C2ugwBDhFzafdgL0QQfrvSncmj+XJ6b5QoyV+Ns3yipa8C1M7+UmJkFDoxw2UHI267BzMqJ1VlGZ9jaIHwM8DIZQ/urRjQXkepfcPzILFu9/lOUXOXcjzVMZ142d7RA==',key_name='tempest-keypair-1255671859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-tvzzxb8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:06:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=48eb80db-7b57-42cf-9555-41909fd0c59f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "address": "fa:16:3e:42:b2:61", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abc82fa-51", "ovs_interfaceid": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "address": "fa:16:3e:42:b2:61", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abc82fa-51", "ovs_interfaceid": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:b2:61,bridge_name='br-int',has_traffic_filtering=True,id=9abc82fa-5119-4b74-897d-39cf6f5c3064,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abc82fa-51') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.objects.instance [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'pci_devices' on Instance uuid 48eb80db-7b57-42cf-9555-41909fd0c59f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:06:19 user nova-compute[75469]:   <uuid>48eb80db-7b57-42cf-9555-41909fd0c59f</uuid>
Nov 14 05:06:19 user nova-compute[75469]:   <name>instance-00000024</name>
Nov 14 05:06:19 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:06:19 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:06:19 user nova-compute[75469]:   <metadata>
Nov 14 05:06:19 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:06:19 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:06:19 user nova-compute[75469]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1385426198</nova:name>
Nov 14 05:06:19 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:06:19</nova:creationTime>
Nov 14 05:06:19 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:06:19 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:06:19 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:06:19 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:06:19 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:06:19 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:06:19 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:06:19 user nova-compute[75469]:       <nova:owner>
Nov 14 05:06:19 user nova-compute[75469]:         <nova:user uuid="e98acc8e0c8044cca5d6f7a35b3bdad0">tempest-AttachVolumeNegativeTest-1768463318-project-member</nova:user>
Nov 14 05:06:19 user nova-compute[75469]:         <nova:project uuid="c59f6cc7c2254d4ba2581a445e02075f">tempest-AttachVolumeNegativeTest-1768463318</nova:project>
Nov 14 05:06:19 user nova-compute[75469]:       </nova:owner>
Nov 14 05:06:19 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:06:19 user nova-compute[75469]:       <nova:ports>
Nov 14 05:06:19 user nova-compute[75469]:         <nova:port uuid="9abc82fa-5119-4b74-897d-39cf6f5c3064">
Nov 14 05:06:19 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 05:06:19 user nova-compute[75469]:         </nova:port>
Nov 14 05:06:19 user nova-compute[75469]:       </nova:ports>
Nov 14 05:06:19 user nova-compute[75469]:     </nova:instance>
Nov 14 05:06:19 user nova-compute[75469]:   </metadata>
Nov 14 05:06:19 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:06:19 user nova-compute[75469]:     <system>
Nov 14 05:06:19 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:06:19 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:06:19 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:06:19 user nova-compute[75469]:       <entry name="serial">48eb80db-7b57-42cf-9555-41909fd0c59f</entry>
Nov 14 05:06:19 user nova-compute[75469]:       <entry name="uuid">48eb80db-7b57-42cf-9555-41909fd0c59f</entry>
Nov 14 05:06:19 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:06:19 user nova-compute[75469]:     </system>
Nov 14 05:06:19 user nova-compute[75469]:   </sysinfo>
Nov 14 05:06:19 user nova-compute[75469]:   <os>
Nov 14 05:06:19 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:06:19 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:06:19 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:06:19 user nova-compute[75469]:   </os>
Nov 14 05:06:19 user nova-compute[75469]:   <features>
Nov 14 05:06:19 user nova-compute[75469]:     <acpi/>
Nov 14 05:06:19 user nova-compute[75469]:     <apic/>
Nov 14 05:06:19 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:06:19 user nova-compute[75469]:   </features>
Nov 14 05:06:19 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:06:19 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:06:19 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:06:19 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:06:19 user nova-compute[75469]:   </clock>
Nov 14 05:06:19 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:06:19 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:06:19 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:06:19 user nova-compute[75469]:   </cpu>
Nov 14 05:06:19 user nova-compute[75469]:   <devices>
Nov 14 05:06:19 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:06:19 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:06:19 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk"/>
Nov 14 05:06:19 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:06:19 user nova-compute[75469]:     </disk>
Nov 14 05:06:19 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:06:19 user nova-compute[75469]:       <mac address="fa:16:3e:42:b2:61"/>
Nov 14 05:06:19 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:06:19 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:06:19 user nova-compute[75469]:       <target dev="tap9abc82fa-51"/>
Nov 14 05:06:19 user nova-compute[75469]:     </interface>
Nov 14 05:06:19 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:06:19 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/console.log" append="off"/>
Nov 14 05:06:19 user nova-compute[75469]:     </serial>
Nov 14 05:06:19 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:06:19 user nova-compute[75469]:     <video>
Nov 14 05:06:19 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:06:19 user nova-compute[75469]:     </video>
Nov 14 05:06:19 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:06:19 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:06:19 user nova-compute[75469]:     </rng>
Nov 14 05:06:19 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:06:19 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:06:19 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:06:19 user nova-compute[75469]:     </memballoon>
Nov 14 05:06:19 user nova-compute[75469]:   </devices>
Nov 14 05:06:19 user nova-compute[75469]: </domain>
Nov 14 05:06:19 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1385426198',display_name='tempest-AttachVolumeNegativeTest-server-1385426198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1385426198',id=36,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8C2ugwBDhFzafdgL0QQfrvSncmj+XJ6b5QoyV+Ns3yipa8C1M7+UmJkFDoxw2UHI267BzMqJ1VlGZ9jaIHwM8DIZQ/urRjQXkepfcPzILFu9/lOUXOXcjzVMZ142d7RA==',key_name='tempest-keypair-1255671859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-tvzzxb8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:06:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=48eb80db-7b57-42cf-9555-41909fd0c59f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "address": "fa:16:3e:42:b2:61", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abc82fa-51", "ovs_interfaceid": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "address": "fa:16:3e:42:b2:61", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abc82fa-51", "ovs_interfaceid": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:b2:61,bridge_name='br-int',has_traffic_filtering=True,id=9abc82fa-5119-4b74-897d-39cf6f5c3064,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abc82fa-51') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG os_vif [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b2:61,bridge_name='br-int',has_traffic_filtering=True,id=9abc82fa-5119-4b74-897d-39cf6f5c3064,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abc82fa-51') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e660b8f-ac47-52ec-bc37-9bd93bac52ec', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9abc82fa-51, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9abc82fa-51, col_values=(('qos', UUID('010126ef-ff9f-4d30-a753-898134f80121')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9abc82fa-51, col_values=(('external_ids', {'iface-id': '9abc82fa-5119-4b74-897d-39cf6f5c3064', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:b2:61', 'vm-uuid': '48eb80db-7b57-42cf-9555-41909fd0c59f'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:19 user nova-compute[75469]: INFO os_vif [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b2:61,bridge_name='br-int',has_traffic_filtering=True,id=9abc82fa-5119-4b74-897d-39cf6f5c3064,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abc82fa-51')
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No VIF found with MAC fa:16:3e:42:b2:61, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:06:19 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Instance spawned successfully.
Nov 14 05:06:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:20 user nova-compute[75469]: INFO nova.compute.manager [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Took 6.41 seconds to spawn the instance on the hypervisor.
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] No waiting events found dispatching network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:06:20 user nova-compute[75469]: WARNING nova.compute.manager [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received unexpected event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 for instance with vm_state building and task_state spawning.
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Received event network-changed-9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Refreshing instance network info cache due to event network-changed-9abc82fa-5119-4b74-897d-39cf6f5c3064. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] Acquiring lock "refresh_cache-48eb80db-7b57-42cf-9555-41909fd0c59f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] Acquired lock "refresh_cache-48eb80db-7b57-42cf-9555-41909fd0c59f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.network.neutron [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Refreshing network info cache for port 9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:06:20 user nova-compute[75469]: INFO nova.compute.manager [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Took 7.22 seconds to build instance.
Nov 14 05:06:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4971bad2-1522-4bdb-98a6-9a008d89272d tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.365s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.network.neutron [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Updated VIF entry in instance network info cache for port 9abc82fa-5119-4b74-897d-39cf6f5c3064. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG nova.network.neutron [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Updating instance_info_cache with network_info: [{"id": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "address": "fa:16:3e:42:b2:61", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abc82fa-51", "ovs_interfaceid": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:06:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-973d6812-03fc-41ec-b7b4-0961b8356a28 req-89fbd6bf-c38b-42cc-9dab-fe0bc98872d3 service nova] Releasing lock "refresh_cache-48eb80db-7b57-42cf-9555-41909fd0c59f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:06:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-83005273-f97d-4b49-947c-b820f28283d0 req-3325ed99-61e6-4107-969c-f2a1845a3d65 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Received event network-vif-plugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-83005273-f97d-4b49-947c-b820f28283d0 req-3325ed99-61e6-4107-969c-f2a1845a3d65 service nova] Acquiring lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-83005273-f97d-4b49-947c-b820f28283d0 req-3325ed99-61e6-4107-969c-f2a1845a3d65 service nova] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-83005273-f97d-4b49-947c-b820f28283d0 req-3325ed99-61e6-4107-969c-f2a1845a3d65 service nova] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-83005273-f97d-4b49-947c-b820f28283d0 req-3325ed99-61e6-4107-969c-f2a1845a3d65 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] No waiting events found dispatching network-vif-plugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:06:21 user nova-compute[75469]: WARNING nova.compute.manager [req-83005273-f97d-4b49-947c-b820f28283d0 req-3325ed99-61e6-4107-969c-f2a1845a3d65 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Received unexpected event network-vif-plugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 for instance with vm_state building and task_state spawning.
Nov 14 05:06:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-ff0004a5-2a00-4b9c-b5a8-343cf33e9094 req-2137e53d-2e6a-4936-aefb-5847c65adba9 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Received event network-vif-plugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ff0004a5-2a00-4b9c-b5a8-343cf33e9094 req-2137e53d-2e6a-4936-aefb-5847c65adba9 service nova] Acquiring lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ff0004a5-2a00-4b9c-b5a8-343cf33e9094 req-2137e53d-2e6a-4936-aefb-5847c65adba9 service nova] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ff0004a5-2a00-4b9c-b5a8-343cf33e9094 req-2137e53d-2e6a-4936-aefb-5847c65adba9 service nova] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-ff0004a5-2a00-4b9c-b5a8-343cf33e9094 req-2137e53d-2e6a-4936-aefb-5847c65adba9 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] No waiting events found dispatching network-vif-plugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:06:23 user nova-compute[75469]: WARNING nova.compute.manager [req-ff0004a5-2a00-4b9c-b5a8-343cf33e9094 req-2137e53d-2e6a-4936-aefb-5847c65adba9 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Received unexpected event network-vif-plugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 for instance with vm_state building and task_state spawning.
Nov 14 05:06:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:06:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Instance spawned successfully.
Nov 14 05:06:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:06:24 user nova-compute[75469]: INFO nova.compute.manager [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 14 05:06:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:06:24 user nova-compute[75469]: INFO nova.compute.manager [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Took 7.22 seconds to build instance.
Nov 14 05:06:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-40012295-13ac-4cb8-9688-7e68156595b4 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.345s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "c8335ffd-314e-43f1-9573-200556415a14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "c8335ffd-314e-43f1-9573-200556415a14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "c8335ffd-314e-43f1-9573-200556415a14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "c8335ffd-314e-43f1-9573-200556415a14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "c8335ffd-314e-43f1-9573-200556415a14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:36 user nova-compute[75469]: INFO nova.compute.manager [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Terminating instance
Nov 14 05:06:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-3ebce972-6d42-4c04-9129-330ccc340bcb req-d899e635-555a-419b-bedd-d00bfeabfc77 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Received event network-vif-unplugged-8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3ebce972-6d42-4c04-9129-330ccc340bcb req-d899e635-555a-419b-bedd-d00bfeabfc77 service nova] Acquiring lock "c8335ffd-314e-43f1-9573-200556415a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3ebce972-6d42-4c04-9129-330ccc340bcb req-d899e635-555a-419b-bedd-d00bfeabfc77 service nova] Lock "c8335ffd-314e-43f1-9573-200556415a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3ebce972-6d42-4c04-9129-330ccc340bcb req-d899e635-555a-419b-bedd-d00bfeabfc77 service nova] Lock "c8335ffd-314e-43f1-9573-200556415a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-3ebce972-6d42-4c04-9129-330ccc340bcb req-d899e635-555a-419b-bedd-d00bfeabfc77 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] No waiting events found dispatching network-vif-unplugged-8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-3ebce972-6d42-4c04-9129-330ccc340bcb req-d899e635-555a-419b-bedd-d00bfeabfc77 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Received event network-vif-unplugged-8367797e-d56a-42f1-a00c-87bbe5c43253 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c8335ffd-314e-43f1-9573-200556415a14] Instance destroyed successfully.
Nov 14 05:06:36 user nova-compute[75469]: DEBUG nova.objects.instance [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lazy-loading 'resources' on Instance uuid c8335ffd-314e-43f1-9573-200556415a14 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-42742565',display_name='tempest-VolumesActionsTest-instance-42742565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-42742565',id=32,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:04:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19aa56a2b2e47648008b954f443ad0d',ramdisk_id='',reservation_id='r-s071nwcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-895657134',owner_user_name='tempest-VolumesActionsTest-895657134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:04:52Z,user_data=None,user_id='95352b2aadd047fc906642a759713a85',uuid=c8335ffd-314e-43f1-9573-200556415a14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8367797e-d56a-42f1-a00c-87bbe5c43253", "address": "fa:16:3e:d3:87:ea", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8367797e-d5", "ovs_interfaceid": "8367797e-d56a-42f1-a00c-87bbe5c43253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converting VIF {"id": "8367797e-d56a-42f1-a00c-87bbe5c43253", "address": "fa:16:3e:d3:87:ea", "network": {"id": "cc9c81e7-171b-41fd-9f27-437225b2fe02", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1440576959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19aa56a2b2e47648008b954f443ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8367797e-d5", "ovs_interfaceid": "8367797e-d56a-42f1-a00c-87bbe5c43253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:87:ea,bridge_name='br-int',has_traffic_filtering=True,id=8367797e-d56a-42f1-a00c-87bbe5c43253,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8367797e-d5') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG os_vif [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:87:ea,bridge_name='br-int',has_traffic_filtering=True,id=8367797e-d56a-42f1-a00c-87bbe5c43253,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8367797e-d5') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8367797e-d5, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80b9b637-35ff-4dd9-a59a-e02c6d84fcd2) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:06:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:36 user nova-compute[75469]: INFO os_vif [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:87:ea,bridge_name='br-int',has_traffic_filtering=True,id=8367797e-d56a-42f1-a00c-87bbe5c43253,network=Network(cc9c81e7-171b-41fd-9f27-437225b2fe02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8367797e-d5')
Nov 14 05:06:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Deleting instance files /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14_del
Nov 14 05:06:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Deletion of /opt/stack/data/nova/instances/c8335ffd-314e-43f1-9573-200556415a14_del complete
Nov 14 05:06:37 user nova-compute[75469]: INFO nova.compute.manager [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] [instance: c8335ffd-314e-43f1-9573-200556415a14] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 14 05:06:37 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:06:37 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: c8335ffd-314e-43f1-9573-200556415a14] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:06:37 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c8335ffd-314e-43f1-9573-200556415a14] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:06:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-a198375a-2b80-463c-a260-f68264656319 req-41e2dedf-5261-4314-b1a5-4cd94f1cde53 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Received event network-vif-deleted-8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:37 user nova-compute[75469]: INFO nova.compute.manager [req-a198375a-2b80-463c-a260-f68264656319 req-41e2dedf-5261-4314-b1a5-4cd94f1cde53 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Neutron deleted interface 8367797e-d56a-42f1-a00c-87bbe5c43253; detaching it from the instance and deleting it from the info cache
Nov 14 05:06:37 user nova-compute[75469]: DEBUG nova.network.neutron [req-a198375a-2b80-463c-a260-f68264656319 req-41e2dedf-5261-4314-b1a5-4cd94f1cde53 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:06:37 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c8335ffd-314e-43f1-9573-200556415a14] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:06:37 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: c8335ffd-314e-43f1-9573-200556415a14] Took 0.58 seconds to deallocate network for instance.
Nov 14 05:06:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-a198375a-2b80-463c-a260-f68264656319 req-41e2dedf-5261-4314-b1a5-4cd94f1cde53 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Detach interface failed, port_id=8367797e-d56a-42f1-a00c-87bbe5c43253, reason: Instance c8335ffd-314e-43f1-9573-200556415a14 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:06:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:37 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:06:37 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:06:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:38 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Deleted allocations for instance c8335ffd-314e-43f1-9573-200556415a14
Nov 14 05:06:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0b3696f1-0477-4f7c-80d7-efc6cf310c00 tempest-VolumesActionsTest-895657134 tempest-VolumesActionsTest-895657134-project-member] Lock "c8335ffd-314e-43f1-9573-200556415a14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.813s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-ef5b2986-4e42-48c2-9ccb-56b2e313d6be req-5b7ee8f7-1f37-4a29-8694-267291d1d526 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Received event network-vif-plugged-8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:06:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ef5b2986-4e42-48c2-9ccb-56b2e313d6be req-5b7ee8f7-1f37-4a29-8694-267291d1d526 service nova] Acquiring lock "c8335ffd-314e-43f1-9573-200556415a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ef5b2986-4e42-48c2-9ccb-56b2e313d6be req-5b7ee8f7-1f37-4a29-8694-267291d1d526 service nova] Lock "c8335ffd-314e-43f1-9573-200556415a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ef5b2986-4e42-48c2-9ccb-56b2e313d6be req-5b7ee8f7-1f37-4a29-8694-267291d1d526 service nova] Lock "c8335ffd-314e-43f1-9573-200556415a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-ef5b2986-4e42-48c2-9ccb-56b2e313d6be req-5b7ee8f7-1f37-4a29-8694-267291d1d526 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] No waiting events found dispatching network-vif-plugged-8367797e-d56a-42f1-a00c-87bbe5c43253 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:06:38 user nova-compute[75469]: WARNING nova.compute.manager [req-ef5b2986-4e42-48c2-9ccb-56b2e313d6be req-5b7ee8f7-1f37-4a29-8694-267291d1d526 service nova] [instance: c8335ffd-314e-43f1-9573-200556415a14] Received unexpected event network-vif-plugged-8367797e-d56a-42f1-a00c-87bbe5c43253 for instance with vm_state deleted and task_state None.
Nov 14 05:06:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updating instance_info_cache with network_info: [{"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-929364ea-9d56-41ff-a393-8abd7df60eec" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:06:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:06:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:06:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:06:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:06:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:06:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:06:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:06:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7667MB free_disk=24.822669982910156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a48d1c5d-db49-4609-9ca4-21f4578d8943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c07c6b3f-e748-4a36-a018-2336000b716d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 87874095-a320-4445-8dd3-b7b259764dfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 9a0c1e54-59d5-4890-9c6c-3bc34928bb65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a8ffecbb-5de1-4425-adc5-77fab650b8bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 48eb80db-7b57-42cf-9555-41909fd0c59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:06:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:07:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:02 user nova-compute[75469]: INFO nova.compute.manager [None req-1229d30a-702a-4fad-b96a-8d91ac86cec1 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Unrescuing
Nov 14 05:07:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1229d30a-702a-4fad-b96a-8d91ac86cec1 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:07:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1229d30a-702a-4fad-b96a-8d91ac86cec1 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquired lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:07:02 user nova-compute[75469]: DEBUG nova.network.neutron [None req-1229d30a-702a-4fad-b96a-8d91ac86cec1 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG nova.network.neutron [None req-1229d30a-702a-4fad-b96a-8d91ac86cec1 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Updating instance_info_cache with network_info: [{"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1229d30a-702a-4fad-b96a-8d91ac86cec1 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Releasing lock "refresh_cache-c07c6b3f-e748-4a36-a018-2336000b716d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG nova.objects.instance [None req-1229d30a-702a-4fad-b96a-8d91ac86cec1 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'flavor' on Instance uuid c07c6b3f-e748-4a36-a018-2336000b716d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-b058e1c0-05e3-4d5a-86e6-3117acfd93e0 req-203713d1-fbb8-4798-b9ef-70e9bc66bfaf service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-unplugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b058e1c0-05e3-4d5a-86e6-3117acfd93e0 req-203713d1-fbb8-4798-b9ef-70e9bc66bfaf service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b058e1c0-05e3-4d5a-86e6-3117acfd93e0 req-203713d1-fbb8-4798-b9ef-70e9bc66bfaf service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b058e1c0-05e3-4d5a-86e6-3117acfd93e0 req-203713d1-fbb8-4798-b9ef-70e9bc66bfaf service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-b058e1c0-05e3-4d5a-86e6-3117acfd93e0 req-203713d1-fbb8-4798-b9ef-70e9bc66bfaf service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-unplugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:07:03 user nova-compute[75469]: WARNING nova.compute.manager [req-b058e1c0-05e3-4d5a-86e6-3117acfd93e0 req-203713d1-fbb8-4798-b9ef-70e9bc66bfaf service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received unexpected event network-vif-unplugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:07:03 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Instance destroyed successfully.
Nov 14 05:07:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:07:05 user nova-compute[75469]: WARNING nova.compute.manager [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received unexpected event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:07:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:05 user nova-compute[75469]: DEBUG nova.compute.manager [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:07:05 user nova-compute[75469]: WARNING nova.compute.manager [req-f0b54da4-55cd-4f0a-bffa-36c357d4170d req-6a9f0160-64c8-4cea-a3e1-22d7ab7b7ae6 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received unexpected event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:07:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-1229d30a-702a-4fad-b96a-8d91ac86cec1 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:07:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-f3693820-e9f3-4011-9555-1e61cac3e5ad req-b69284b0-82a0-4058-8db7-01f8031a81e8 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f3693820-e9f3-4011-9555-1e61cac3e5ad req-b69284b0-82a0-4058-8db7-01f8031a81e8 service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f3693820-e9f3-4011-9555-1e61cac3e5ad req-b69284b0-82a0-4058-8db7-01f8031a81e8 service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f3693820-e9f3-4011-9555-1e61cac3e5ad req-b69284b0-82a0-4058-8db7-01f8031a81e8 service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-f3693820-e9f3-4011-9555-1e61cac3e5ad req-b69284b0-82a0-4058-8db7-01f8031a81e8 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:07:07 user nova-compute[75469]: WARNING nova.compute.manager [req-f3693820-e9f3-4011-9555-1e61cac3e5ad req-b69284b0-82a0-4058-8db7-01f8031a81e8 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received unexpected event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with vm_state active and task_state None.
Nov 14 05:07:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Acquiring lock "699c7785-d380-47b4-8ff3-b67e059af4ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:07:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:15 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:07:15 user nova-compute[75469]: INFO nova.compute.claims [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Claim successful on node user
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-490e45b7-f05d-4cc3-a687-76c0aa557a45 req-73d638f3-d7a2-4326-be37-65d818742e75 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received event network-changed-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-490e45b7-f05d-4cc3-a687-76c0aa557a45 req-73d638f3-d7a2-4326-be37-65d818742e75 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Refreshing instance network info cache due to event network-changed-e410b203-a06b-4d47-b021-cd273d307573. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-490e45b7-f05d-4cc3-a687-76c0aa557a45 req-73d638f3-d7a2-4326-be37-65d818742e75 service nova] Acquiring lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-490e45b7-f05d-4cc3-a687-76c0aa557a45 req-73d638f3-d7a2-4326-be37-65d818742e75 service nova] Acquired lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.network.neutron [req-490e45b7-f05d-4cc3-a687-76c0aa557a45 req-73d638f3-d7a2-4326-be37-65d818742e75 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Refreshing network info cache for port e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:07:16 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.policy [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb365160669b4e51a79fbb9ffba2dbc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d6d718b86b444ab9a48aff480d3333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:07:16 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Creating image(s)
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Acquiring lock "/opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "/opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "/opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "87874095-a320-4445-8dd3-b7b259764dfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.253s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lazy-loading 'flavor' on Instance uuid 87874095-a320-4445-8dd3-b7b259764dfa {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:07:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-490e45b7-f05d-4cc3-a687-76c0aa557a45 req-73d638f3-d7a2-4326-be37-65d818742e75 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Updated VIF entry in instance network info cache for port e410b203-a06b-4d47-b021-cd273d307573. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-490e45b7-f05d-4cc3-a687-76c0aa557a45 req-73d638f3-d7a2-4326-be37-65d818742e75 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Updating instance_info_cache with network_info: [{"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.234s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-490e45b7-f05d-4cc3-a687-76c0aa557a45 req-73d638f3-d7a2-4326-be37-65d818742e75 service nova] Releasing lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "87874095-a320-4445-8dd3-b7b259764dfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:17 user nova-compute[75469]: INFO nova.compute.manager [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Attaching volume ae0103f2-27b6-4f14-b101-042e2d2324c3 to /dev/vdb
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk 1073741824" returned: 0 in 0.215s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.452s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG os_brick.utils [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[889df216-de11-400f-97bc-0904c767b4ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Successfully created port: a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d023dde-7f27-4924-a9b5-ff52abd91980]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfdac08-15bd-499d-aaab-e3d1469558ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2f6e2c-53b6-4ae5-a53b-1eaf6139536e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.230s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:07:17 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff125fa-741d-4a33-971d-22976387faa5]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG os_brick.utils [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Updating existing volume attachment record: 8e785db0-0d49-4423-bb63-c8ba9e1468ab {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Cannot resize image /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Ensure instance console log exists: /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Successfully updated port: a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Acquiring lock "refresh_cache-699c7785-d380-47b4-8ff3-b67e059af4ae" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Acquired lock "refresh_cache-699c7785-d380-47b4-8ff3-b67e059af4ae" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-9410c34f-0658-404b-9ee5-1aad849893e0 req-7498f693-a003-4160-bb66-579fca10d9aa service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Received event network-changed-a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-9410c34f-0658-404b-9ee5-1aad849893e0 req-7498f693-a003-4160-bb66-579fca10d9aa service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Refreshing instance network info cache due to event network-changed-a3afeaa6-666a-4d2d-8864-95e08a476641. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9410c34f-0658-404b-9ee5-1aad849893e0 req-7498f693-a003-4160-bb66-579fca10d9aa service nova] Acquiring lock "refresh_cache-699c7785-d380-47b4-8ff3-b67e059af4ae" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Updating instance_info_cache with network_info: [{"id": "a3afeaa6-666a-4d2d-8864-95e08a476641", "address": "fa:16:3e:14:4d:68", "network": {"id": "233d1673-adbe-4fdd-8e04-19bdf75e9480", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629333611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d6d718b86b444ab9a48aff480d3333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3afeaa6-66", "ovs_interfaceid": "a3afeaa6-666a-4d2d-8864-95e08a476641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Releasing lock "refresh_cache-699c7785-d380-47b4-8ff3-b67e059af4ae" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Instance network_info: |[{"id": "a3afeaa6-666a-4d2d-8864-95e08a476641", "address": "fa:16:3e:14:4d:68", "network": {"id": "233d1673-adbe-4fdd-8e04-19bdf75e9480", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629333611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d6d718b86b444ab9a48aff480d3333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3afeaa6-66", "ovs_interfaceid": "a3afeaa6-666a-4d2d-8864-95e08a476641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9410c34f-0658-404b-9ee5-1aad849893e0 req-7498f693-a003-4160-bb66-579fca10d9aa service nova] Acquired lock "refresh_cache-699c7785-d380-47b4-8ff3-b67e059af4ae" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-9410c34f-0658-404b-9ee5-1aad849893e0 req-7498f693-a003-4160-bb66-579fca10d9aa service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Refreshing network info cache for port a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Start _get_guest_xml network_info=[{"id": "a3afeaa6-666a-4d2d-8864-95e08a476641", "address": "fa:16:3e:14:4d:68", "network": {"id": "233d1673-adbe-4fdd-8e04-19bdf75e9480", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629333611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d6d718b86b444ab9a48aff480d3333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3afeaa6-66", "ovs_interfaceid": "a3afeaa6-666a-4d2d-8864-95e08a476641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:07:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:07:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2078356054',display_name='tempest-VolumesActionsTest-instance-2078356054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2078356054',id=37,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73d6d718b86b444ab9a48aff480d3333',ramdisk_id='',reservation_id='r-olat6t92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1628468413',owner_user_name='tempest-VolumesActionsTest-1628468413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:07:16Z,user_data=None,user_id='fb365160669b4e51a79fbb9ffba2dbc5',uuid=699c7785-d380-47b4-8ff3-b67e059af4ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3afeaa6-666a-4d2d-8864-95e08a476641", "address": "fa:16:3e:14:4d:68", "network": {"id": "233d1673-adbe-4fdd-8e04-19bdf75e9480", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629333611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d6d718b86b444ab9a48aff480d3333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3afeaa6-66", "ovs_interfaceid": "a3afeaa6-666a-4d2d-8864-95e08a476641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Converting VIF {"id": "a3afeaa6-666a-4d2d-8864-95e08a476641", "address": "fa:16:3e:14:4d:68", "network": {"id": "233d1673-adbe-4fdd-8e04-19bdf75e9480", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629333611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d6d718b86b444ab9a48aff480d3333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3afeaa6-66", "ovs_interfaceid": "a3afeaa6-666a-4d2d-8864-95e08a476641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4d:68,bridge_name='br-int',has_traffic_filtering=True,id=a3afeaa6-666a-4d2d-8864-95e08a476641,network=Network(233d1673-adbe-4fdd-8e04-19bdf75e9480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3afeaa6-66') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lazy-loading 'pci_devices' on Instance uuid 699c7785-d380-47b4-8ff3-b67e059af4ae {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:07:19 user nova-compute[75469]:   <uuid>699c7785-d380-47b4-8ff3-b67e059af4ae</uuid>
Nov 14 05:07:19 user nova-compute[75469]:   <name>instance-00000025</name>
Nov 14 05:07:19 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:07:19 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:07:19 user nova-compute[75469]:   <metadata>
Nov 14 05:07:19 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:07:19 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:07:19 user nova-compute[75469]:       <nova:name>tempest-VolumesActionsTest-instance-2078356054</nova:name>
Nov 14 05:07:19 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:07:19</nova:creationTime>
Nov 14 05:07:19 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:07:19 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:07:19 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:07:19 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:07:19 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:07:19 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:07:19 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:07:19 user nova-compute[75469]:       <nova:owner>
Nov 14 05:07:19 user nova-compute[75469]:         <nova:user uuid="fb365160669b4e51a79fbb9ffba2dbc5">tempest-VolumesActionsTest-1628468413-project-member</nova:user>
Nov 14 05:07:19 user nova-compute[75469]:         <nova:project uuid="73d6d718b86b444ab9a48aff480d3333">tempest-VolumesActionsTest-1628468413</nova:project>
Nov 14 05:07:19 user nova-compute[75469]:       </nova:owner>
Nov 14 05:07:19 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:07:19 user nova-compute[75469]:       <nova:ports>
Nov 14 05:07:19 user nova-compute[75469]:         <nova:port uuid="a3afeaa6-666a-4d2d-8864-95e08a476641">
Nov 14 05:07:19 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 05:07:19 user nova-compute[75469]:         </nova:port>
Nov 14 05:07:19 user nova-compute[75469]:       </nova:ports>
Nov 14 05:07:19 user nova-compute[75469]:     </nova:instance>
Nov 14 05:07:19 user nova-compute[75469]:   </metadata>
Nov 14 05:07:19 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:07:19 user nova-compute[75469]:     <system>
Nov 14 05:07:19 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:07:19 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:07:19 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:07:19 user nova-compute[75469]:       <entry name="serial">699c7785-d380-47b4-8ff3-b67e059af4ae</entry>
Nov 14 05:07:19 user nova-compute[75469]:       <entry name="uuid">699c7785-d380-47b4-8ff3-b67e059af4ae</entry>
Nov 14 05:07:19 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:07:19 user nova-compute[75469]:     </system>
Nov 14 05:07:19 user nova-compute[75469]:   </sysinfo>
Nov 14 05:07:19 user nova-compute[75469]:   <os>
Nov 14 05:07:19 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:07:19 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:07:19 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:07:19 user nova-compute[75469]:   </os>
Nov 14 05:07:19 user nova-compute[75469]:   <features>
Nov 14 05:07:19 user nova-compute[75469]:     <acpi/>
Nov 14 05:07:19 user nova-compute[75469]:     <apic/>
Nov 14 05:07:19 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:07:19 user nova-compute[75469]:   </features>
Nov 14 05:07:19 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:07:19 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:07:19 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:07:19 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:07:19 user nova-compute[75469]:   </clock>
Nov 14 05:07:19 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:07:19 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:07:19 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:07:19 user nova-compute[75469]:   </cpu>
Nov 14 05:07:19 user nova-compute[75469]:   <devices>
Nov 14 05:07:19 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:07:19 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:07:19 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk"/>
Nov 14 05:07:19 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:07:19 user nova-compute[75469]:     </disk>
Nov 14 05:07:19 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:07:19 user nova-compute[75469]:       <mac address="fa:16:3e:14:4d:68"/>
Nov 14 05:07:19 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:07:19 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:07:19 user nova-compute[75469]:       <target dev="tapa3afeaa6-66"/>
Nov 14 05:07:19 user nova-compute[75469]:     </interface>
Nov 14 05:07:19 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:07:19 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/console.log" append="off"/>
Nov 14 05:07:19 user nova-compute[75469]:     </serial>
Nov 14 05:07:19 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:07:19 user nova-compute[75469]:     <video>
Nov 14 05:07:19 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:07:19 user nova-compute[75469]:     </video>
Nov 14 05:07:19 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:07:19 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:07:19 user nova-compute[75469]:     </rng>
Nov 14 05:07:19 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:07:19 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:07:19 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:07:19 user nova-compute[75469]:     </memballoon>
Nov 14 05:07:19 user nova-compute[75469]:   </devices>
Nov 14 05:07:19 user nova-compute[75469]: </domain>
Nov 14 05:07:19 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2078356054',display_name='tempest-VolumesActionsTest-instance-2078356054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2078356054',id=37,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73d6d718b86b444ab9a48aff480d3333',ramdisk_id='',reservation_id='r-olat6t92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1628468413',owner_user_name='tempest-VolumesActionsTest-1628468413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:07:16Z,user_data=None,user_id='fb365160669b4e51a79fbb9ffba2dbc5',uuid=699c7785-d380-47b4-8ff3-b67e059af4ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3afeaa6-666a-4d2d-8864-95e08a476641", "address": "fa:16:3e:14:4d:68", "network": {"id": "233d1673-adbe-4fdd-8e04-19bdf75e9480", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629333611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d6d718b86b444ab9a48aff480d3333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3afeaa6-66", "ovs_interfaceid": "a3afeaa6-666a-4d2d-8864-95e08a476641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Converting VIF {"id": "a3afeaa6-666a-4d2d-8864-95e08a476641", "address": "fa:16:3e:14:4d:68", "network": {"id": "233d1673-adbe-4fdd-8e04-19bdf75e9480", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629333611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d6d718b86b444ab9a48aff480d3333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3afeaa6-66", "ovs_interfaceid": "a3afeaa6-666a-4d2d-8864-95e08a476641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4d:68,bridge_name='br-int',has_traffic_filtering=True,id=a3afeaa6-666a-4d2d-8864-95e08a476641,network=Network(233d1673-adbe-4fdd-8e04-19bdf75e9480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3afeaa6-66') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG os_vif [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4d:68,bridge_name='br-int',has_traffic_filtering=True,id=a3afeaa6-666a-4d2d-8864-95e08a476641,network=Network(233d1673-adbe-4fdd-8e04-19bdf75e9480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3afeaa6-66') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bead384-116c-57ac-a3f4-aa144b54a387', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3afeaa6-66, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3afeaa6-66, col_values=(('qos', UUID('4896eab0-41d7-46e4-9be1-4ed5295e94f7')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3afeaa6-66, col_values=(('external_ids', {'iface-id': 'a3afeaa6-666a-4d2d-8864-95e08a476641', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:4d:68', 'vm-uuid': '699c7785-d380-47b4-8ff3-b67e059af4ae'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:19 user nova-compute[75469]: INFO os_vif [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4d:68,bridge_name='br-int',has_traffic_filtering=True,id=a3afeaa6-666a-4d2d-8864-95e08a476641,network=Network(233d1673-adbe-4fdd-8e04-19bdf75e9480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3afeaa6-66')
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] No VIF found with MAC fa:16:3e:14:4d:68, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-9410c34f-0658-404b-9ee5-1aad849893e0 req-7498f693-a003-4160-bb66-579fca10d9aa service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Updated VIF entry in instance network info cache for port a3afeaa6-666a-4d2d-8864-95e08a476641. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-9410c34f-0658-404b-9ee5-1aad849893e0 req-7498f693-a003-4160-bb66-579fca10d9aa service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Updating instance_info_cache with network_info: [{"id": "a3afeaa6-666a-4d2d-8864-95e08a476641", "address": "fa:16:3e:14:4d:68", "network": {"id": "233d1673-adbe-4fdd-8e04-19bdf75e9480", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629333611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d6d718b86b444ab9a48aff480d3333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3afeaa6-66", "ovs_interfaceid": "a3afeaa6-666a-4d2d-8864-95e08a476641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:07:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9410c34f-0658-404b-9ee5-1aad849893e0 req-7498f693-a003-4160-bb66-579fca10d9aa service nova] Releasing lock "refresh_cache-699c7785-d380-47b4-8ff3-b67e059af4ae" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:07:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:07:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:07:20 user nova-compute[75469]: INFO nova.compute.claims [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Claim successful on node user
Nov 14 05:07:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-d1264031-d725-4a40-b713-1009f9a4a541 req-ec5f7260-0ffd-4f9f-9483-d77c771340c0 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Received event network-vif-plugged-a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1264031-d725-4a40-b713-1009f9a4a541 req-ec5f7260-0ffd-4f9f-9483-d77c771340c0 service nova] Acquiring lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1264031-d725-4a40-b713-1009f9a4a541 req-ec5f7260-0ffd-4f9f-9483-d77c771340c0 service nova] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1264031-d725-4a40-b713-1009f9a4a541 req-ec5f7260-0ffd-4f9f-9483-d77c771340c0 service nova] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-d1264031-d725-4a40-b713-1009f9a4a541 req-ec5f7260-0ffd-4f9f-9483-d77c771340c0 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] No waiting events found dispatching network-vif-plugged-a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:07:21 user nova-compute[75469]: WARNING nova.compute.manager [req-d1264031-d725-4a40-b713-1009f9a4a541 req-ec5f7260-0ffd-4f9f-9483-d77c771340c0 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Received unexpected event network-vif-plugged-a3afeaa6-666a-4d2d-8864-95e08a476641 for instance with vm_state building and task_state spawning.
Nov 14 05:07:21 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.737s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:21 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:07:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG nova.policy [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6212f1c3188246c6b94e3ad485d6174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e916ef90975b40bdb9a887d02e4770dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:07:21 user nova-compute[75469]: INFO nova.virt.block_device [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Booting with volume 729b4621-6005-4246-b7bc-58b8d80f0088 at /dev/vda
Nov 14 05:07:21 user nova-compute[75469]: DEBUG os_brick.utils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[86df1fd7-e086-4d2d-933b-9831c2ca56c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c512ae-8a60-44a0-89cd-124769789105]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e2e5f-77a3-4116-9539-99341576e4e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ca9abf-74ad-4fd9-960e-cffa2a3089fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:07:22 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[997f9300-99c8-4b27-9c7a-cf86310bda9c]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.utils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating existing volume attachment record: 26f11111-2604-4731-bf90-29fbfe9dedaf {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoqgDPQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:07:22 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:07:22 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:07:22 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f14eac-2376-43e6-9315-e3852772c07d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:07:22 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd489e03-818b-440c-91aa-9aad4a386dbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3] added
Nov 14 05:07:22 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e479de3-ea00-4f2f-a810-aa671dc29822]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f050b38-ce28-4c7d-8d2c-9b0e3158625d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoqgDPQN {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoqgDPQN" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c39ec30-9c0e-41d7-97f9-5950cdf4a0ac]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zoqgDPQN'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f55cffc-8642-41bc-8a78-cae09c931680]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d416d525-d47b-41c4-85d9-ac21a03c1b74]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:07:22 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:07:22 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:07:22 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:07:22 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:07:22 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:07:22 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Successfully created port: c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5332070e-63c1-4b33-92f2-97d4a7c177b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3, portal: 172.16.0.220,3260]
Nov 14 05:07:22 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3, portal: 172.16.0.220,3260] successful.
Nov 14 05:07:22 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2110c9e-a61d-49dd-88e7-5b653e5b9d8d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[860fc1cd-7e67-4f27-8ffe-2776347e07e9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:07:22 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:07:22 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:07:22 user nova-compute[75469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)
Nov 14 05:07:22 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:07:22 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:07:22 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:07:22 user nova-compute[75469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)
Nov 14 05:07:22 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f57e23-0e59-4e73-b6d0-72057e0605e4]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:22 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Successfully updated port: c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-902de006-b0d1-423a-b643-5c7e09b4be44 req-db9b5cbc-b2b3-427f-a5d3-67c6ecdc2843 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Received event network-vif-plugged-a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-902de006-b0d1-423a-b643-5c7e09b4be44 req-db9b5cbc-b2b3-427f-a5d3-67c6ecdc2843 service nova] Acquiring lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-902de006-b0d1-423a-b643-5c7e09b4be44 req-db9b5cbc-b2b3-427f-a5d3-67c6ecdc2843 service nova] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-902de006-b0d1-423a-b643-5c7e09b4be44 req-db9b5cbc-b2b3-427f-a5d3-67c6ecdc2843 service nova] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-902de006-b0d1-423a-b643-5c7e09b4be44 req-db9b5cbc-b2b3-427f-a5d3-67c6ecdc2843 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] No waiting events found dispatching network-vif-plugged-a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:07:23 user nova-compute[75469]: WARNING nova.compute.manager [req-902de006-b0d1-423a-b643-5c7e09b4be44 req-db9b5cbc-b2b3-427f-a5d3-67c6ecdc2843 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Received unexpected event network-vif-plugged-a3afeaa6-666a-4d2d-8864-95e08a476641 for instance with vm_state building and task_state spawning.
Nov 14 05:07:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquired lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-3eabe496-1294-425f-954f-6e945d046ee3 req-f2af7b6f-7257-4e12-b2d4-b458d9de6b42 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-changed-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.compute.manager [req-3eabe496-1294-425f-954f-6e945d046ee3 req-f2af7b6f-7257-4e12-b2d4-b458d9de6b42 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Refreshing instance network info cache due to event network-changed-c3c21b15-f830-41d9-a5b6-242a097ac43d. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3eabe496-1294-425f-954f-6e945d046ee3 req-f2af7b6f-7257-4e12-b2d4-b458d9de6b42 service nova] Acquiring lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:07:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Instance spawned successfully.
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:23 user nova-compute[75469]: INFO nova.compute.manager [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:07:23 user nova-compute[75469]: INFO nova.compute.manager [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Took 7.98 seconds to build instance.
Nov 14 05:07:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8442f531-b410-42ce-8982-9d5ca36146d0 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.076s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating instance_info_cache with network_info: [{"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Releasing lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Instance network_info: |[{"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3eabe496-1294-425f-954f-6e945d046ee3 req-f2af7b6f-7257-4e12-b2d4-b458d9de6b42 service nova] Acquired lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-3eabe496-1294-425f-954f-6e945d046ee3 req-f2af7b6f-7257-4e12-b2d4-b458d9de6b42 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Refreshing network info cache for port c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoqgDPQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23534353163343664', 'path': '/dev/sde'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534353163343664', 'path': '/dev/sde'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lazy-loading 'flavor' on Instance uuid 87874095-a320-4445-8dd3-b7b259764dfa {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:07:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:07:23 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:07:23 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:07:23 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:07:23 user nova-compute[75469]:   <serial>ae0103f2-27b6-4f14-b101-042e2d2324c3</serial>
Nov 14 05:07:23 user nova-compute[75469]: </disk>
Nov 14 05:07:23 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:07:24 user nova-compute[75469]: DEBUG nova.network.neutron [req-3eabe496-1294-425f-954f-6e945d046ee3 req-f2af7b6f-7257-4e12-b2d4-b458d9de6b42 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updated VIF entry in instance network info cache for port c3c21b15-f830-41d9-a5b6-242a097ac43d. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:07:24 user nova-compute[75469]: DEBUG nova.network.neutron [req-3eabe496-1294-425f-954f-6e945d046ee3 req-f2af7b6f-7257-4e12-b2d4-b458d9de6b42 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating instance_info_cache with network_info: [{"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:07:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3eabe496-1294-425f-954f-6e945d046ee3 req-f2af7b6f-7257-4e12-b2d4-b458d9de6b42 service nova] Releasing lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:07:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:07:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:07:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] No VIF found with MAC fa:16:3e:6f:cf:ad, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:07:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b22d9d46-4133-4e02-83a5-76d080802f44 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.229s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "87874095-a320-4445-8dd3-b7b259764dfa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:26 user nova-compute[75469]: INFO nova.compute.manager [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Detaching volume ae0103f2-27b6-4f14-b101-042e2d2324c3
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:07:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Creating image(s)
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Ensure instance console log exists: /opt/stack/data/nova/instances/e74a9e8f-2e86-4de9-9d39-5192cf5763c5/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Start _get_guest_xml network_info=[{"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '26f11111-2604-4731-bf90-29fbfe9dedaf', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnfNGRUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e74a9e8f-2e86-4de9-9d39-5192cf5763c5', 'attached_at': '', 'detached_at': '', 'volume_id': '729b4621-6005-4246-b7bc-58b8d80f0088', 'serial': '729b4621-6005-4246-b7bc-58b8d80f0088'}, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:07:26 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:07:26 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:07:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnfNGRUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:07:27 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:07:27 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:07:27 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:07:27 user nova-compute[75469]: INFO nova.virt.block_device [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Attempting to driver detach volume ae0103f2-27b6-4f14-b101-042e2d2324c3 from mountpoint /dev/vdb
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Attempting to detach device vdb from instance 87874095-a320-4445-8dd3-b7b259764dfa from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:07:27 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:07:27 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:07:27 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:07:27 user nova-compute[75469]:   <serial>ae0103f2-27b6-4f14-b101-042e2d2324c3</serial>
Nov 14 05:07:27 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:07:27 user nova-compute[75469]: </disk>
Nov 14 05:07:27 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:07:27 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Successfully detached device vdb from instance 87874095-a320-4445-8dd3-b7b259764dfa from the persistent domain config.
Nov 14 05:07:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87874095-a320-4445-8dd3-b7b259764dfa from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:07:27 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:07:27 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:07:27 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:07:27 user nova-compute[75469]:   <serial>ae0103f2-27b6-4f14-b101-042e2d2324c3</serial>
Nov 14 05:07:27 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:07:27 user nova-compute[75469]: </disk>
Nov 14 05:07:27 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7f706d-7445-429c-bd1e-278df4cf8ec8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:07:27 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d634c21e-1b16-44e1-abab-6363935a46cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088] added
Nov 14 05:07:27 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd93dd9a-1bc3-4d48-a27f-a6832d5b3c5b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43cb97a-c450-4ea9-975e-d80c4febb4ef]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnfNGRUF {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnfNGRUF" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a49ef5f-5527-41d6-92a4-7e737d25a3e0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qnfNGRUF'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd7ecc8-bea8-4ef3-b8d9-7cca32ecced8]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125dd33-8682-4890-a082-4fa9ec1101d2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[05842b9e-6a52-4ea2-a609-d794f525c4d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260]
Nov 14 05:07:27 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260] successful.
Nov 14 05:07:27 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ebea58-29c6-4f4e-8916-75bec68627d1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[730ef2af-bbcb-4eb7-9a3d-9bee6ba298bd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:07:27 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[951751ea-124a-45f4-ad0e-1abe22c17c27]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnfNGRUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:07:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87874095-a320-4445-8dd3-b7b259764dfa {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26339373133643531', 'path': '/dev/sdf'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339373133643531', 'path': '/dev/sdf'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116243024',display_name='tempest-TestShelveInstance-server-2116243024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116243024',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0Qas8BH6l6FqQNvGoTG+Iy1AxUhx83WtDJZDKWmaIXfJT4oouE9iO/yf9IlPc8wEtovlgdDqLYXUh2SCgAu1eJ4kPF7B3On30+g0vXPcFEBA/m60Gz6wl1aUtqlaIm5w==',key_name='tempest-TestShelveInstance-848916377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e916ef90975b40bdb9a887d02e4770dd',ramdisk_id='',reservation_id='r-qjebm1o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1973652568',owner_user_name='tempest-TestShelveInstance-1973652568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:07:22Z,user_data=None,user_id='6212f1c3188246c6b94e3ad485d6174f',uuid=e74a9e8f-2e86-4de9-9d39-5192cf5763c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converting VIF {"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG nova.objects.instance [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lazy-loading 'pci_devices' on Instance uuid e74a9e8f-2e86-4de9-9d39-5192cf5763c5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:07:28 user nova-compute[75469]:   <uuid>e74a9e8f-2e86-4de9-9d39-5192cf5763c5</uuid>
Nov 14 05:07:28 user nova-compute[75469]:   <name>instance-00000026</name>
Nov 14 05:07:28 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:07:28 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:07:28 user nova-compute[75469]:   <metadata>
Nov 14 05:07:28 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:07:28 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:07:28 user nova-compute[75469]:       <nova:name>tempest-TestShelveInstance-server-2116243024</nova:name>
Nov 14 05:07:28 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:07:26</nova:creationTime>
Nov 14 05:07:28 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:07:28 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:07:28 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:07:28 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:07:28 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:07:28 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:07:28 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:07:28 user nova-compute[75469]:       <nova:owner>
Nov 14 05:07:28 user nova-compute[75469]:         <nova:user uuid="6212f1c3188246c6b94e3ad485d6174f">tempest-TestShelveInstance-1973652568-project-member</nova:user>
Nov 14 05:07:28 user nova-compute[75469]:         <nova:project uuid="e916ef90975b40bdb9a887d02e4770dd">tempest-TestShelveInstance-1973652568</nova:project>
Nov 14 05:07:28 user nova-compute[75469]:       </nova:owner>
Nov 14 05:07:28 user nova-compute[75469]:       <nova:ports>
Nov 14 05:07:28 user nova-compute[75469]:         <nova:port uuid="c3c21b15-f830-41d9-a5b6-242a097ac43d">
Nov 14 05:07:28 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 05:07:28 user nova-compute[75469]:         </nova:port>
Nov 14 05:07:28 user nova-compute[75469]:       </nova:ports>
Nov 14 05:07:28 user nova-compute[75469]:     </nova:instance>
Nov 14 05:07:28 user nova-compute[75469]:   </metadata>
Nov 14 05:07:28 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:07:28 user nova-compute[75469]:     <system>
Nov 14 05:07:28 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:07:28 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:07:28 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:07:28 user nova-compute[75469]:       <entry name="serial">e74a9e8f-2e86-4de9-9d39-5192cf5763c5</entry>
Nov 14 05:07:28 user nova-compute[75469]:       <entry name="uuid">e74a9e8f-2e86-4de9-9d39-5192cf5763c5</entry>
Nov 14 05:07:28 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:07:28 user nova-compute[75469]:     </system>
Nov 14 05:07:28 user nova-compute[75469]:   </sysinfo>
Nov 14 05:07:28 user nova-compute[75469]:   <os>
Nov 14 05:07:28 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:07:28 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:07:28 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:07:28 user nova-compute[75469]:   </os>
Nov 14 05:07:28 user nova-compute[75469]:   <features>
Nov 14 05:07:28 user nova-compute[75469]:     <acpi/>
Nov 14 05:07:28 user nova-compute[75469]:     <apic/>
Nov 14 05:07:28 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:07:28 user nova-compute[75469]:   </features>
Nov 14 05:07:28 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:07:28 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:07:28 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:07:28 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:07:28 user nova-compute[75469]:   </clock>
Nov 14 05:07:28 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:07:28 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:07:28 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:07:28 user nova-compute[75469]:   </cpu>
Nov 14 05:07:28 user nova-compute[75469]:   <devices>
Nov 14 05:07:28 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:07:28 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:07:28 user nova-compute[75469]:       <source dev="/dev/sdf"/>
Nov 14 05:07:28 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:07:28 user nova-compute[75469]:       <serial>729b4621-6005-4246-b7bc-58b8d80f0088</serial>
Nov 14 05:07:28 user nova-compute[75469]:     </disk>
Nov 14 05:07:28 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:07:28 user nova-compute[75469]:       <mac address="fa:16:3e:4b:d4:04"/>
Nov 14 05:07:28 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:07:28 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:07:28 user nova-compute[75469]:       <target dev="tapc3c21b15-f8"/>
Nov 14 05:07:28 user nova-compute[75469]:     </interface>
Nov 14 05:07:28 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:07:28 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/e74a9e8f-2e86-4de9-9d39-5192cf5763c5/console.log" append="off"/>
Nov 14 05:07:28 user nova-compute[75469]:     </serial>
Nov 14 05:07:28 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:07:28 user nova-compute[75469]:     <video>
Nov 14 05:07:28 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:07:28 user nova-compute[75469]:     </video>
Nov 14 05:07:28 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:07:28 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:07:28 user nova-compute[75469]:     </rng>
Nov 14 05:07:28 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:07:28 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:07:28 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:07:28 user nova-compute[75469]:     </memballoon>
Nov 14 05:07:28 user nova-compute[75469]:   </devices>
Nov 14 05:07:28 user nova-compute[75469]: </domain>
Nov 14 05:07:28 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116243024',display_name='tempest-TestShelveInstance-server-2116243024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116243024',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0Qas8BH6l6FqQNvGoTG+Iy1AxUhx83WtDJZDKWmaIXfJT4oouE9iO/yf9IlPc8wEtovlgdDqLYXUh2SCgAu1eJ4kPF7B3On30+g0vXPcFEBA/m60Gz6wl1aUtqlaIm5w==',key_name='tempest-TestShelveInstance-848916377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e916ef90975b40bdb9a887d02e4770dd',ramdisk_id='',reservation_id='r-qjebm1o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1973652568',owner_user_name='tempest-TestShelveInstance-1973652568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:07:22Z,user_data=None,user_id='6212f1c3188246c6b94e3ad485d6174f',uuid=e74a9e8f-2e86-4de9-9d39-5192cf5763c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converting VIF {"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG os_vif [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a192486d-9eab-5987-9a2f-11528c62c773', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3c21b15-f8, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3c21b15-f8, col_values=(('qos', UUID('12aed8bc-b91d-4172-8fb9-e7f96ef07c49')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3c21b15-f8, col_values=(('external_ids', {'iface-id': 'c3c21b15-f830-41d9-a5b6-242a097ac43d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:d4:04', 'vm-uuid': 'e74a9e8f-2e86-4de9-9d39-5192cf5763c5'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:28 user nova-compute[75469]: INFO os_vif [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8')
Nov 14 05:07:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:07:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] No VIF found with MAC fa:16:3e:4b:d4:04, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:07:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-1948a11a-236d-405d-906f-642bf8e90865 req-1696fa07-386d-4c4a-8aec-2b6747b21333 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1948a11a-236d-405d-906f-642bf8e90865 req-1696fa07-386d-4c4a-8aec-2b6747b21333 service nova] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1948a11a-236d-405d-906f-642bf8e90865 req-1696fa07-386d-4c4a-8aec-2b6747b21333 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1948a11a-236d-405d-906f-642bf8e90865 req-1696fa07-386d-4c4a-8aec-2b6747b21333 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-1948a11a-236d-405d-906f-642bf8e90865 req-1696fa07-386d-4c4a-8aec-2b6747b21333 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] No waiting events found dispatching network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:07:30 user nova-compute[75469]: WARNING nova.compute.manager [req-1948a11a-236d-405d-906f-642bf8e90865 req-1696fa07-386d-4c4a-8aec-2b6747b21333 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received unexpected event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d for instance with vm_state building and task_state spawning.
Nov 14 05:07:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:07:32 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Instance spawned successfully.
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:07:32 user nova-compute[75469]: INFO nova.compute.manager [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:07:32 user nova-compute[75469]: INFO nova.compute.manager [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Took 11.55 seconds to build instance.
Nov 14 05:07:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-478ba097-77bc-4e96-aed1-9f89cda9d059 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.672s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-d9572659-b533-4c86-9dc6-524e25405c0f req-340e1064-aa8d-4c96-a23a-0316d3eb08bb service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d9572659-b533-4c86-9dc6-524e25405c0f req-340e1064-aa8d-4c96-a23a-0316d3eb08bb service nova] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d9572659-b533-4c86-9dc6-524e25405c0f req-340e1064-aa8d-4c96-a23a-0316d3eb08bb service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d9572659-b533-4c86-9dc6-524e25405c0f req-340e1064-aa8d-4c96-a23a-0316d3eb08bb service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-d9572659-b533-4c86-9dc6-524e25405c0f req-340e1064-aa8d-4c96-a23a-0316d3eb08bb service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] No waiting events found dispatching network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:07:32 user nova-compute[75469]: WARNING nova.compute.manager [req-d9572659-b533-4c86-9dc6-524e25405c0f req-340e1064-aa8d-4c96-a23a-0316d3eb08bb service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received unexpected event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d for instance with vm_state active and task_state None.
Nov 14 05:07:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:47 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 87874095-a320-4445-8dd3-b7b259764dfa is timed out.
Nov 14 05:07:47 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Successfully detached device vdb from instance 87874095-a320-4445-8dd3-b7b259764dfa from the live domain config.
Nov 14 05:07:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoqgDPQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:07:47 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.161s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cee7875-7af0-4b5c-82df-b2301b22b161]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ea17f98-8e16-4b2e-ad1a-2726f4e12fa7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:07:47 user nova-compute[75469]: No targets found.
Nov 14 05:07:47 user nova-compute[75469]: iSNS:
Nov 14 05:07:47 user nova-compute[75469]: No targets found.
Nov 14 05:07:47 user nova-compute[75469]: STATIC:
Nov 14 05:07:47 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5
Nov 14 05:07:47 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:07:47 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:07:47 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088
Nov 14 05:07:47 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:07:47 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:07:47 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:0ea17f98-8e16-4b2e-ad1a-2726f4e12fa7
Nov 14 05:07:47 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:07:47 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:07:47 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:07:47 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:07:47 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:07:47 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a
Nov 14 05:07:47 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:07:47 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:07:47 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3
Nov 14 05:07:47 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:07:47 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:07:47 user nova-compute[75469]: FIRMWARE:
Nov 14 05:07:47 user nova-compute[75469]: No targets found.
Nov 14 05:07:47 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:07:47 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:07:47 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0254ff-99b4-4d1e-befb-b09023fad927]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ea17f98-8e16-4b2e-ad1a-2726f4e12fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b4e8f8-1f93-4065-9bec-f58ba69e3120]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ea17f98-8e16-4b2e-ad1a-2726f4e12fa7 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:07:47 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:07:47 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:07:47 user nova-compute[75469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)
Nov 14 05:07:47 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:07:47 user nova-compute[75469]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ea17f98-8e16-4b2e-ad1a-2726f4e12fa7 (non-flash)
Nov 14 05:07:47 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:07:47 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:07:47 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:07:47 user nova-compute[75469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 (non-flash)
Nov 14 05:07:47 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:07:47 user nova-compute[75469]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ea17f98-8e16-4b2e-ad1a-2726f4e12fa7 (non-flash)
Nov 14 05:07:47 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708d97e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3'): ({'sde'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Removing single pathed devices sde {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[43972b14-6e69-42f3-8d5c-8257f7cb9d33]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[63363e0d-88c8-4780-bcb3-a86e991ed8f5]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Flushing IO for device /dev/sde {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.069s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f6805e-e896-4985-8ae8-a2ba52cfd0bc]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:07:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.265s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf532bc-1e8c-47b9-9a69-c100d7fe40d5]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.054s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebbced9-728e-47d7-806f-6971919c571f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.336s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[54788d53-6c66-4e2f-844a-f6dca7f852a8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3, portal: 172.16.0.220,3260]
Nov 14 05:07:48 user nova-compute[75469]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3, portal: 172.16.0.220,3260] successful.
Nov 14 05:07:48 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0103f2-27b6-4f14-b101-042e2d2324c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.157s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb407e7-b0ac-4ec7-81a9-af4a7f8dc082]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.204s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] <== disconnect_volume: return (1205ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:07:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:07:50 user nova-compute[75469]: DEBUG nova.objects.instance [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lazy-loading 'flavor' on Instance uuid 87874095-a320-4445-8dd3-b7b259764dfa {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:07:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d3ffc3df-9065-4638-ab68-dcffc556dca3 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.218s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-2be22cce-907b-4f06-aa43-d594742b26c0 req-c16ec136-4f7c-49af-af98-2e57fee17ead service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Received event network-changed-213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-2be22cce-907b-4f06-aa43-d594742b26c0 req-c16ec136-4f7c-49af-af98-2e57fee17ead service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Refreshing instance network info cache due to event network-changed-213df0cd-0a8b-4c7d-a71c-4210adbadf4d. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2be22cce-907b-4f06-aa43-d594742b26c0 req-c16ec136-4f7c-49af-af98-2e57fee17ead service nova] Acquiring lock "refresh_cache-9a0c1e54-59d5-4890-9c6c-3bc34928bb65" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2be22cce-907b-4f06-aa43-d594742b26c0 req-c16ec136-4f7c-49af-af98-2e57fee17ead service nova] Acquired lock "refresh_cache-9a0c1e54-59d5-4890-9c6c-3bc34928bb65" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG nova.network.neutron [req-2be22cce-907b-4f06-aa43-d594742b26c0 req-c16ec136-4f7c-49af-af98-2e57fee17ead service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Refreshing network info cache for port 213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG nova.network.neutron [req-2be22cce-907b-4f06-aa43-d594742b26c0 req-c16ec136-4f7c-49af-af98-2e57fee17ead service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Updated VIF entry in instance network info cache for port 213df0cd-0a8b-4c7d-a71c-4210adbadf4d. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG nova.network.neutron [req-2be22cce-907b-4f06-aa43-d594742b26c0 req-c16ec136-4f7c-49af-af98-2e57fee17ead service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Updating instance_info_cache with network_info: [{"id": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "address": "fa:16:3e:c4:7a:7d", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213df0cd-0a", "ovs_interfaceid": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2be22cce-907b-4f06-aa43-d594742b26c0 req-c16ec136-4f7c-49af-af98-2e57fee17ead service nova] Releasing lock "refresh_cache-9a0c1e54-59d5-4890-9c6c-3bc34928bb65" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:07:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:07:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7441MB free_disk=24.781341552734375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a48d1c5d-db49-4609-9ca4-21f4578d8943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c07c6b3f-e748-4a36-a018-2336000b716d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 87874095-a320-4445-8dd3-b7b259764dfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 9a0c1e54-59d5-4890-9c6c-3bc34928bb65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a8ffecbb-5de1-4425-adc5-77fab650b8bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 48eb80db-7b57-42cf-9555-41909fd0c59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 699c7785-d380-47b4-8ff3-b67e059af4ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance e74a9e8f-2e86-4de9-9d39-5192cf5763c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 05:07:57 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 05:07:58 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:07:58 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:07:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:07:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.798s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:07:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:58 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 05:07:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-a48d1c5d-db49-4609-9ca4-21f4578d8943" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-a48d1c5d-db49-4609-9ca4-21f4578d8943" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Updating instance_info_cache with network_info: [{"id": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "address": "fa:16:3e:4f:d1:31", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa47bcc-04", "ovs_interfaceid": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-a48d1c5d-db49-4609-9ca4-21f4578d8943" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:07:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:08:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:08:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:08:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "2048496d-3733-4ca5-b27a-f6be129b7c0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:08:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:01 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:08:01 user nova-compute[75469]: INFO nova.compute.claims [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Claim successful on node user
Nov 14 05:08:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:01 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:08:01 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:08:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:02 user nova-compute[75469]: DEBUG nova.compute.manager [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:08:02 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:08:02 user nova-compute[75469]: DEBUG nova.compute.manager [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:08:02 user nova-compute[75469]: DEBUG nova.network.neutron [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:08:02 user nova-compute[75469]: DEBUG nova.compute.manager [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:08:02 user nova-compute[75469]: DEBUG nova.policy [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0155ca3745514d6c8c0ab08a9182df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf022cc839af44ff89e4249410c4a9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:08:02 user nova-compute[75469]: INFO nova.virt.block_device [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Booting with volume snapshot 27387625-f5f5-4752-ba7e-6f72b3fc30e0 at /dev/vda
Nov 14 05:08:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:02 user nova-compute[75469]: DEBUG nova.network.neutron [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Successfully created port: 72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG nova.network.neutron [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Successfully updated port: 72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "refresh_cache-2048496d-3733-4ca5-b27a-f6be129b7c0b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquired lock "refresh_cache-2048496d-3733-4ca5-b27a-f6be129b7c0b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG nova.network.neutron [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-0b52108d-d209-4c28-86a8-d7c21ad6000d req-95e60cab-4e4e-47c4-b158-f57d6206aeef service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Received event network-changed-72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG nova.compute.manager [req-0b52108d-d209-4c28-86a8-d7c21ad6000d req-95e60cab-4e4e-47c4-b158-f57d6206aeef service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Refreshing instance network info cache due to event network-changed-72a9a068-1244-4e81-a5cc-d72092e3280f. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0b52108d-d209-4c28-86a8-d7c21ad6000d req-95e60cab-4e4e-47c4-b158-f57d6206aeef service nova] Acquiring lock "refresh_cache-2048496d-3733-4ca5-b27a-f6be129b7c0b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG nova.network.neutron [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG nova.network.neutron [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Updating instance_info_cache with network_info: [{"id": "72a9a068-1244-4e81-a5cc-d72092e3280f", "address": "fa:16:3e:58:bc:28", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a9a068-12", "ovs_interfaceid": "72a9a068-1244-4e81-a5cc-d72092e3280f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Releasing lock "refresh_cache-2048496d-3733-4ca5-b27a-f6be129b7c0b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG nova.compute.manager [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Instance network_info: |[{"id": "72a9a068-1244-4e81-a5cc-d72092e3280f", "address": "fa:16:3e:58:bc:28", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a9a068-12", "ovs_interfaceid": "72a9a068-1244-4e81-a5cc-d72092e3280f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0b52108d-d209-4c28-86a8-d7c21ad6000d req-95e60cab-4e4e-47c4-b158-f57d6206aeef service nova] Acquired lock "refresh_cache-2048496d-3733-4ca5-b27a-f6be129b7c0b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:08:03 user nova-compute[75469]: DEBUG nova.network.neutron [req-0b52108d-d209-4c28-86a8-d7c21ad6000d req-95e60cab-4e4e-47c4-b158-f57d6206aeef service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Refreshing network info cache for port 72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-5903473d-3e6b-48f6-b97e-e3207e3ecc74 req-32ad04a3-0c2b-40d4-8686-d08a88a4acca service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-changed-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-5903473d-3e6b-48f6-b97e-e3207e3ecc74 req-32ad04a3-0c2b-40d4-8686-d08a88a4acca service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Refreshing instance network info cache due to event network-changed-5b19d7a7-df11-4a7b-b994-e62b40a91600. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5903473d-3e6b-48f6-b97e-e3207e3ecc74 req-32ad04a3-0c2b-40d4-8686-d08a88a4acca service nova] Acquiring lock "refresh_cache-a8ffecbb-5de1-4425-adc5-77fab650b8bf" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5903473d-3e6b-48f6-b97e-e3207e3ecc74 req-32ad04a3-0c2b-40d4-8686-d08a88a4acca service nova] Acquired lock "refresh_cache-a8ffecbb-5de1-4425-adc5-77fab650b8bf" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG nova.network.neutron [req-5903473d-3e6b-48f6-b97e-e3207e3ecc74 req-32ad04a3-0c2b-40d4-8686-d08a88a4acca service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Refreshing network info cache for port 5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'flavor' on Instance uuid a8ffecbb-5de1-4425-adc5-77fab650b8bf {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:04 user nova-compute[75469]: INFO nova.compute.manager [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Attaching volume fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 to /dev/vdb
Nov 14 05:08:04 user nova-compute[75469]: DEBUG os_brick.utils [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.080s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4e81d0-e047-4ced-a482-1770b71c40d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ca61fd-1736-4856-87b7-e8f256ce946c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.060s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aa779b-4adf-4592-8af5-40cd552e2ae0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c52467-e1a2-4def-902f-9c871889ec49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG nova.network.neutron [req-0b52108d-d209-4c28-86a8-d7c21ad6000d req-95e60cab-4e4e-47c4-b158-f57d6206aeef service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Updated VIF entry in instance network info cache for port 72a9a068-1244-4e81-a5cc-d72092e3280f. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG nova.network.neutron [req-0b52108d-d209-4c28-86a8-d7c21ad6000d req-95e60cab-4e4e-47c4-b158-f57d6206aeef service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Updating instance_info_cache with network_info: [{"id": "72a9a068-1244-4e81-a5cc-d72092e3280f", "address": "fa:16:3e:58:bc:28", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a9a068-12", "ovs_interfaceid": "72a9a068-1244-4e81-a5cc-d72092e3280f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0b52108d-d209-4c28-86a8-d7c21ad6000d req-95e60cab-4e4e-47c4-b158-f57d6206aeef service nova] Releasing lock "refresh_cache-2048496d-3733-4ca5-b27a-f6be129b7c0b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:08:05 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4003cbe-8cf8-4ac6-8a3a-59e3ba8a3d6b]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG os_brick.utils [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== get_connector_properties: return (243ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Updating existing volume attachment record: 181ae8c8-2756-4882-b4a2-a3602a66a178 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG nova.network.neutron [req-5903473d-3e6b-48f6-b97e-e3207e3ecc74 req-32ad04a3-0c2b-40d4-8686-d08a88a4acca service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Updated VIF entry in instance network info cache for port 5b19d7a7-df11-4a7b-b994-e62b40a91600. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG nova.network.neutron [req-5903473d-3e6b-48f6-b97e-e3207e3ecc74 req-32ad04a3-0c2b-40d4-8686-d08a88a4acca service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Updating instance_info_cache with network_info: [{"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:08:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5903473d-3e6b-48f6-b97e-e3207e3ecc74 req-32ad04a3-0c2b-40d4-8686-d08a88a4acca service nova] Releasing lock "refresh_cache-a8ffecbb-5de1-4425-adc5-77fab650b8bf" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:08:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:08:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-15377b3e-c9d0-4b70-a0f5-2d84fc85918b req-d5458aa8-1fc2-4de4-97c3-9bc939cdfd3b service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Received event network-changed-9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-15377b3e-c9d0-4b70-a0f5-2d84fc85918b req-d5458aa8-1fc2-4de4-97c3-9bc939cdfd3b service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Refreshing instance network info cache due to event network-changed-9abc82fa-5119-4b74-897d-39cf6f5c3064. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-15377b3e-c9d0-4b70-a0f5-2d84fc85918b req-d5458aa8-1fc2-4de4-97c3-9bc939cdfd3b service nova] Acquiring lock "refresh_cache-48eb80db-7b57-42cf-9555-41909fd0c59f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-15377b3e-c9d0-4b70-a0f5-2d84fc85918b req-d5458aa8-1fc2-4de4-97c3-9bc939cdfd3b service nova] Acquired lock "refresh_cache-48eb80db-7b57-42cf-9555-41909fd0c59f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG nova.network.neutron [req-15377b3e-c9d0-4b70-a0f5-2d84fc85918b req-d5458aa8-1fc2-4de4-97c3-9bc939cdfd3b service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Refreshing network info cache for port 9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG os_brick.utils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a65ccd0-3e10-45c3-b007-e12e6d3d5eee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7caf7ad-72c3-47f4-ad27-2ecd2c1119cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5842742-4d4e-4f4c-9fc0-016d565ad7e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[008d869a-8e60-4fed-a574-5f9720474022]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:08:07 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:08:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[482fdb4b-7746-4377-b2ba-daa69810a0d8]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG os_brick.utils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:07 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Updating existing volume attachment record: 385a439a-6f3d-404a-aa8f-665f7b97f27a {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:08:08 user nova-compute[75469]: DEBUG nova.network.neutron [req-15377b3e-c9d0-4b70-a0f5-2d84fc85918b req-d5458aa8-1fc2-4de4-97c3-9bc939cdfd3b service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Updated VIF entry in instance network info cache for port 9abc82fa-5119-4b74-897d-39cf6f5c3064. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:08:08 user nova-compute[75469]: DEBUG nova.network.neutron [req-15377b3e-c9d0-4b70-a0f5-2d84fc85918b req-d5458aa8-1fc2-4de4-97c3-9bc939cdfd3b service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Updating instance_info_cache with network_info: [{"id": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "address": "fa:16:3e:42:b2:61", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abc82fa-51", "ovs_interfaceid": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:08:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-15377b3e-c9d0-4b70-a0f5-2d84fc85918b req-d5458aa8-1fc2-4de4-97c3-9bc939cdfd3b service nova] Releasing lock "refresh_cache-48eb80db-7b57-42cf-9555-41909fd0c59f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:08:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyVnfLjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:09 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:09 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:09 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c77f7c-fe69-46a1-982f-4e96fdf4d9e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:08:09 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7afa9e-0a29-4f46-a960-9c43d75a5515]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2] added
Nov 14 05:08:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e769d93a-d5c0-45ce-8144-711c95eb20d9]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aec5a70-5859-4dbc-a866-84bd7f34cab4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FyVnfLjx {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FyVnfLjx" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f1f5c0-f576-426c-af6f-3f40845c9f95]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FyVnfLjx'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48757d86-9ac7-4316-a70a-7834c028c469]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[259b61d8-6e14-4680-839a-7ac0aefc28fd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0efac6d-fb8f-4a69-9379-9d9adfe98092]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260]
Nov 14 05:08:09 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260] successful.
Nov 14 05:08:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[decab329-a461-4623-bdfe-036f5a2fa98f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca4a36e-1ac3-48e8-a44a-0a35c7d07a38]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:09 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df4a17a-be39-4ef0-8d55-d354f2d4e71f]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:09 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "48eb80db-7b57-42cf-9555-41909fd0c59f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG nova.objects.instance [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'flavor' on Instance uuid 48eb80db-7b57-42cf-9555-41909fd0c59f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "48eb80db-7b57-42cf-9555-41909fd0c59f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:10 user nova-compute[75469]: INFO nova.compute.manager [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Attaching volume b261a421-0388-400b-b538-d0c24dd71dce to /dev/vdb
Nov 14 05:08:10 user nova-compute[75469]: DEBUG os_brick.utils [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3fc86e-df82-487c-a1ba-4b8ffde78054]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a413317f-4919-4311-860a-f0863f1de0a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f61eaab-7d8e-41bf-9b35-f2e4f2edfa8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45118ae-c942-46a8-8239-7384e35ff8e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:08:10 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:08:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4696e64-af84-468c-8305-afd40fce2cc1]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG os_brick.utils [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Updating existing volume attachment record: f9a32dba-b760-40b1-9f92-1d78a1992261 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyVnfLjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23331653735316231', 'path': '/dev/sde'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331653735316231', 'path': '/dev/sde'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'flavor' on Instance uuid a8ffecbb-5de1-4425-adc5-77fab650b8bf {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:08:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:08:10 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:08:10 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:08:10 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:08:10 user nova-compute[75469]:   <serial>fcb5090a-f0b5-4a17-bdf8-12dce9765cf2</serial>
Nov 14 05:08:10 user nova-compute[75469]: </disk>
Nov 14 05:08:10 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:08:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:08:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:08:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No VIF found with MAC fa:16:3e:c5:30:3f, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:08:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ffc2002a-3f42-4689-91fe-72bedce4a446 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.582s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.compute.manager [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:08:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Creating image(s)
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Ensure instance console log exists: /opt/stack/data/nova/instances/2048496d-3733-4ca5-b27a-f6be129b7c0b/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Start _get_guest_xml network_info=[{"id": "72a9a068-1244-4e81-a5cc-d72092e3280f", "address": "fa:16:3e:58:bc:28", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a9a068-12", "ovs_interfaceid": "72a9a068-1244-4e81-a5cc-d72092e3280f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T05:07:57Z,direct_url=<?>,disk_format='qcow2',id=32de5403-110d-422f-9ef0-666fc4983f07,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-361404299',owner='bf022cc839af44ff89e4249410c4a9e4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T05:07:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '385a439a-6f3d-404a-aa8f-665f7b97f27a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqLbiNCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2048496d-3733-4ca5-b27a-f6be129b7c0b', 'attached_at': '', 'detached_at': '', 'volume_id': '151f7a9f-3545-4445-83a9-a25acb53351e', 'serial': '151f7a9f-3545-4445-83a9-a25acb53351e'}, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:08:12 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:08:12 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T05:07:57Z,direct_url=<?>,disk_format='qcow2',id=32de5403-110d-422f-9ef0-666fc4983f07,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-361404299',owner='bf022cc839af44ff89e4249410c4a9e4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T05:07:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqLbiNCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:12 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:12 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:12 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf726615-a293-4a8e-9a32-1422e3d7c9d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:08:12 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d599059f-bf3a-4c72-b100-38f591e08b81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e] added
Nov 14 05:08:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7a5e95-d946-4adf-abd8-9c6011012596]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f950679-03a7-4f49-a505-02eba73a9870]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QqLbiNCn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QqLbiNCn" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c25ce60-8ac9-4751-afbd-e9710b7e25d4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QqLbiNCn'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1e3d04-760e-449a-ae84-c872367acd6b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a65ae2a-5fe3-44ad-bbe7-6cb1fc9fe868]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:12 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:12 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:12 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:12 user nova-compute[75469]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:12 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:12 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:12 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:12 user nova-compute[75469]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a046c6-cb82-4913-a07e-3d9799d60cdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e, portal: 172.16.0.220,3260]
Nov 14 05:08:13 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e, portal: 172.16.0.220,3260] successful.
Nov 14 05:08:13 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafb6331-177b-432d-9164-aff952f5cd8f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ced77b-801d-498b-817c-a59451c2d9e0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:13 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:13 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:13 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:13 user nova-compute[75469]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:13 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:13 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:13 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:13 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:13 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:13 user nova-compute[75469]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:13 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:13 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] HCTL ('38', '-', '-', 0) found on session 43 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[71671fad-5e1b-4256-9996-0721c257e5a2]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqLbiNCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:08:13 user nova-compute[75469]: INFO nova.compute.manager [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Rebuilding instance
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-641cc04d-2c4c-493a-96f2-b0d1df120717 req-7021d3bd-0d0b-4ed2-9fca-ae6907187634 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-vif-unplugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-641cc04d-2c4c-493a-96f2-b0d1df120717 req-7021d3bd-0d0b-4ed2-9fca-ae6907187634 service nova] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-641cc04d-2c4c-493a-96f2-b0d1df120717 req-7021d3bd-0d0b-4ed2-9fca-ae6907187634 service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-641cc04d-2c4c-493a-96f2-b0d1df120717 req-7021d3bd-0d0b-4ed2-9fca-ae6907187634 service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-641cc04d-2c4c-493a-96f2-b0d1df120717 req-7021d3bd-0d0b-4ed2-9fca-ae6907187634 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] No waiting events found dispatching network-vif-unplugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:08:13 user nova-compute[75469]: WARNING nova.compute.manager [req-641cc04d-2c4c-493a-96f2-b0d1df120717 req-7021d3bd-0d0b-4ed2-9fca-ae6907187634 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received unexpected event network-vif-unplugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 for instance with vm_state active and task_state rebuilding.
Nov 14 05:08:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:14 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Instance destroyed successfully.
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23163663461626537', 'path': '/dev/sdg'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163663461626537', 'path': '/dev/sdg'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1350518321',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1350518321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1350518321',id=39,image_ref='32de5403-110d-422f-9ef0-666fc4983f07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPfKpGWMXAuLcucSH4PsyBKfbT7MK9RVuXaV+6BOVOGhamgSw/2pl0Z8lYCc1EEaGK39WbZ/ksSMulG6KZo7QQLeF0z3+tMKv7K/CGXuKukpvdLCutXGuOOaf8TNr7/rQ==',key_name='tempest-keypair-1732056113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-eo1bzjgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-43343925',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=2048496d-3733-4ca5-b27a-f6be129b7c0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a9a068-1244-4e81-a5cc-d72092e3280f", "address": "fa:16:3e:58:bc:28", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a9a068-12", "ovs_interfaceid": "72a9a068-1244-4e81-a5cc-d72092e3280f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "72a9a068-1244-4e81-a5cc-d72092e3280f", "address": "fa:16:3e:58:bc:28", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a9a068-12", "ovs_interfaceid": "72a9a068-1244-4e81-a5cc-d72092e3280f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:bc:28,bridge_name='br-int',has_traffic_filtering=True,id=72a9a068-1244-4e81-a5cc-d72092e3280f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a9a068-12') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.objects.instance [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'pci_devices' on Instance uuid 2048496d-3733-4ca5-b27a-f6be129b7c0b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:08:14 user nova-compute[75469]: INFO nova.compute.manager [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Detaching volume fcb5090a-f0b5-4a17-bdf8-12dce9765cf2
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:08:14 user nova-compute[75469]:   <uuid>2048496d-3733-4ca5-b27a-f6be129b7c0b</uuid>
Nov 14 05:08:14 user nova-compute[75469]:   <name>instance-00000027</name>
Nov 14 05:08:14 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:08:14 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:08:14 user nova-compute[75469]:   <metadata>
Nov 14 05:08:14 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:08:14 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:08:14 user nova-compute[75469]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1350518321</nova:name>
Nov 14 05:08:14 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:08:12</nova:creationTime>
Nov 14 05:08:14 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:08:14 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:08:14 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:08:14 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:08:14 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:08:14 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:08:14 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:08:14 user nova-compute[75469]:       <nova:owner>
Nov 14 05:08:14 user nova-compute[75469]:         <nova:user uuid="0155ca3745514d6c8c0ab08a9182df53">tempest-TestVolumeBootPattern-43343925-project-member</nova:user>
Nov 14 05:08:14 user nova-compute[75469]:         <nova:project uuid="bf022cc839af44ff89e4249410c4a9e4">tempest-TestVolumeBootPattern-43343925</nova:project>
Nov 14 05:08:14 user nova-compute[75469]:       </nova:owner>
Nov 14 05:08:14 user nova-compute[75469]:       <nova:root type="image" uuid="32de5403-110d-422f-9ef0-666fc4983f07"/>
Nov 14 05:08:14 user nova-compute[75469]:       <nova:ports>
Nov 14 05:08:14 user nova-compute[75469]:         <nova:port uuid="72a9a068-1244-4e81-a5cc-d72092e3280f">
Nov 14 05:08:14 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 05:08:14 user nova-compute[75469]:         </nova:port>
Nov 14 05:08:14 user nova-compute[75469]:       </nova:ports>
Nov 14 05:08:14 user nova-compute[75469]:     </nova:instance>
Nov 14 05:08:14 user nova-compute[75469]:   </metadata>
Nov 14 05:08:14 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:08:14 user nova-compute[75469]:     <system>
Nov 14 05:08:14 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:08:14 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:08:14 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:08:14 user nova-compute[75469]:       <entry name="serial">2048496d-3733-4ca5-b27a-f6be129b7c0b</entry>
Nov 14 05:08:14 user nova-compute[75469]:       <entry name="uuid">2048496d-3733-4ca5-b27a-f6be129b7c0b</entry>
Nov 14 05:08:14 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:08:14 user nova-compute[75469]:     </system>
Nov 14 05:08:14 user nova-compute[75469]:   </sysinfo>
Nov 14 05:08:14 user nova-compute[75469]:   <os>
Nov 14 05:08:14 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:08:14 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:08:14 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:08:14 user nova-compute[75469]:   </os>
Nov 14 05:08:14 user nova-compute[75469]:   <features>
Nov 14 05:08:14 user nova-compute[75469]:     <acpi/>
Nov 14 05:08:14 user nova-compute[75469]:     <apic/>
Nov 14 05:08:14 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:08:14 user nova-compute[75469]:   </features>
Nov 14 05:08:14 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:08:14 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:08:14 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:08:14 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:08:14 user nova-compute[75469]:   </clock>
Nov 14 05:08:14 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:08:14 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:08:14 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:08:14 user nova-compute[75469]:   </cpu>
Nov 14 05:08:14 user nova-compute[75469]:   <devices>
Nov 14 05:08:14 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:08:14 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:08:14 user nova-compute[75469]:       <source dev="/dev/sdg"/>
Nov 14 05:08:14 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:08:14 user nova-compute[75469]:       <serial>151f7a9f-3545-4445-83a9-a25acb53351e</serial>
Nov 14 05:08:14 user nova-compute[75469]:     </disk>
Nov 14 05:08:14 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:08:14 user nova-compute[75469]:       <mac address="fa:16:3e:58:bc:28"/>
Nov 14 05:08:14 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:08:14 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:08:14 user nova-compute[75469]:       <target dev="tap72a9a068-12"/>
Nov 14 05:08:14 user nova-compute[75469]:     </interface>
Nov 14 05:08:14 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:08:14 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/2048496d-3733-4ca5-b27a-f6be129b7c0b/console.log" append="off"/>
Nov 14 05:08:14 user nova-compute[75469]:     </serial>
Nov 14 05:08:14 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:08:14 user nova-compute[75469]:     <video>
Nov 14 05:08:14 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:08:14 user nova-compute[75469]:     </video>
Nov 14 05:08:14 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:08:14 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:08:14 user nova-compute[75469]:     </rng>
Nov 14 05:08:14 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:08:14 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:08:14 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:08:14 user nova-compute[75469]:     </memballoon>
Nov 14 05:08:14 user nova-compute[75469]:   </devices>
Nov 14 05:08:14 user nova-compute[75469]: </domain>
Nov 14 05:08:14 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1350518321',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1350518321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1350518321',id=39,image_ref='32de5403-110d-422f-9ef0-666fc4983f07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPfKpGWMXAuLcucSH4PsyBKfbT7MK9RVuXaV+6BOVOGhamgSw/2pl0Z8lYCc1EEaGK39WbZ/ksSMulG6KZo7QQLeF0z3+tMKv7K/CGXuKukpvdLCutXGuOOaf8TNr7/rQ==',key_name='tempest-keypair-1732056113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-eo1bzjgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-43343925',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=2048496d-3733-4ca5-b27a-f6be129b7c0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a9a068-1244-4e81-a5cc-d72092e3280f", "address": "fa:16:3e:58:bc:28", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a9a068-12", "ovs_interfaceid": "72a9a068-1244-4e81-a5cc-d72092e3280f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "72a9a068-1244-4e81-a5cc-d72092e3280f", "address": "fa:16:3e:58:bc:28", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a9a068-12", "ovs_interfaceid": "72a9a068-1244-4e81-a5cc-d72092e3280f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:bc:28,bridge_name='br-int',has_traffic_filtering=True,id=72a9a068-1244-4e81-a5cc-d72092e3280f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a9a068-12') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_vif [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:bc:28,bridge_name='br-int',has_traffic_filtering=True,id=72a9a068-1244-4e81-a5cc-d72092e3280f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a9a068-12') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfdbbe81-5a03-525f-a543-10d79f88f5d9', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72a9a068-12, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72a9a068-12, col_values=(('qos', UUID('3e522a89-bb4a-45e0-9432-54a2f84d416a')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72a9a068-12, col_values=(('external_ids', {'iface-id': '72a9a068-1244-4e81-a5cc-d72092e3280f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:bc:28', 'vm-uuid': '2048496d-3733-4ca5-b27a-f6be129b7c0b'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:14 user nova-compute[75469]: INFO os_vif [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:bc:28,bridge_name='br-int',has_traffic_filtering=True,id=72a9a068-1244-4e81-a5cc-d72092e3280f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a9a068-12')
Nov 14 05:08:14 user nova-compute[75469]: INFO nova.virt.block_device [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Attempting to driver detach volume fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 from mountpoint /dev/vdb
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Attempting to detach device vdb from instance a8ffecbb-5de1-4425-adc5-77fab650b8bf from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:08:14 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:08:14 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:08:14 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:08:14 user nova-compute[75469]:   <serial>fcb5090a-f0b5-4a17-bdf8-12dce9765cf2</serial>
Nov 14 05:08:14 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:08:14 user nova-compute[75469]: </disk>
Nov 14 05:08:14 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:08:14 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully detached device vdb from instance a8ffecbb-5de1-4425-adc5-77fab650b8bf from the persistent domain config.
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyVnfLjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:14 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No VIF found with MAC fa:16:3e:58:bc:28, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[196f59d6-b4c5-429a-8654-1ec46a40d661]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:08:14 user nova-compute[75469]: No targets found.
Nov 14 05:08:14 user nova-compute[75469]: iSNS:
Nov 14 05:08:14 user nova-compute[75469]: No targets found.
Nov 14 05:08:14 user nova-compute[75469]: STATIC:
Nov 14 05:08:14 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e
Nov 14 05:08:14 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:14 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:14 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5
Nov 14 05:08:14 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:14 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:14 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088
Nov 14 05:08:14 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:14 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:14 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:08:14 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:14 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:14 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a
Nov 14 05:08:14 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:14 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:14 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2
Nov 14 05:08:14 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:14 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:14 user nova-compute[75469]: FIRMWARE:
Nov 14 05:08:14 user nova-compute[75469]: No targets found.
Nov 14 05:08:14 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:08:14 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:08:14 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb2c584-87de-49a3-961f-02dd7af4f5b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3460bea0-69ce-4269-8985-edf82b1cf120]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:14 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:14 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:14 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:14 user nova-compute[75469]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:14 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:14 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:14 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:14 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:14 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:14 user nova-compute[75469]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:14 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:14 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75a02dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2'): ({'sde'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Removing single pathed devices sde {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d4d9ae-043a-4d7c-948e-57bfc81d9c97]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc2da39-1af6-43c4-9608-25a97ce96b4b]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flushing IO for device /dev/sde {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfd93a8-5508-4942-a585-f40e09255531]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ab4c10-63bc-4ef0-ad59-17aa35bc2db5]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[078247a2-8fc1-46e9-af16-b96c0d266d25]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b9f3a5-86e3-4258-90e9-57c301525768]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260]
Nov 14 05:08:14 user nova-compute[75469]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260] successful.
Nov 14 05:08:14 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[509ac982-8d39-44bc-83f0-ff0e164167f0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== disconnect_volume: return (341ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTrDjAxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:14 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:14 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:14 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1647cc77-1e19-48be-8813-826e10bfd360]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:08:14 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c70f27-3324-4321-989d-63e15d6c7ed5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce] added
Nov 14 05:08:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97fcde1-2cc1-4d1e-9ab1-a36d9d0c7dc0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad19870b-57e7-4544-893a-33201f1d0140]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iTrDjAxy {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iTrDjAxy" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a6e64e-15c0-4941-b52a-0ab21d289dc6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iTrDjAxy'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb33b19-b8a2-4326-a15f-2a848ea1986a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20996a7-dcf4-4769-a3b2-1f7faedcfe2b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b178555-3ca5-4721-84db-42962daff114]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce, portal: 172.16.0.220,3260]
Nov 14 05:08:15 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce, portal: 172.16.0.220,3260] successful.
Nov 14 05:08:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1666dca-8c9f-4cd8-bc4c-7a10a2ff02fe]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[299cd20b-d44e-4b32-af7c-df7b4d35e62d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)
Nov 14 05:08:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:15 user nova-compute[75469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)
Nov 14 05:08:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80e27a4-0cc9-404b-8e71-2ef4e247b2a3]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTrDjAxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:08:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Instance destroyed successfully.
Nov 14 05:08:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-371085368',display_name='tempest-ServerActionsTestOtherA-server-978815786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-371085368',id=35,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEGTjKqJtkw69dGeCfipwwu89LWWzigSdhele3X3LHWVxYIXIwfNlKlD+XZzmRdKkrwU9RQT/IBBp6eeTDS+MZRGWNM5TH35v1mw59FjYgHxSYncm9QShDeNALd4AjFug==',key_name='tempest-keypair-1304959429',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-s900r63d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:08:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a8ffecbb-5de1-4425-adc5-77fab650b8bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_vif [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b19d7a7-df, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10c55498-2c08-4a77-930f-3c049dbbf201) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:15 user nova-compute[75469]: INFO os_vif [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df')
Nov 14 05:08:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyVnfLjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:15 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 05:08:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-1e5abf8b-298c-4935-be2f-68b88b461b91 req-fe9a1bab-2824-4628-a291-1e823d91b94c service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1e5abf8b-298c-4935-be2f-68b88b461b91 req-fe9a1bab-2824-4628-a291-1e823d91b94c service nova] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1e5abf8b-298c-4935-be2f-68b88b461b91 req-fe9a1bab-2824-4628-a291-1e823d91b94c service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1e5abf8b-298c-4935-be2f-68b88b461b91 req-fe9a1bab-2824-4628-a291-1e823d91b94c service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-1e5abf8b-298c-4935-be2f-68b88b461b91 req-fe9a1bab-2824-4628-a291-1e823d91b94c service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] No waiting events found dispatching network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:08:15 user nova-compute[75469]: WARNING nova.compute.manager [req-1e5abf8b-298c-4935-be2f-68b88b461b91 req-fe9a1bab-2824-4628-a291-1e823d91b94c service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received unexpected event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 for instance with vm_state active and task_state rebuilding.
Nov 14 05:08:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-36dcb641-9987-48b2-8559-f53a8358716f req-2b849f06-d449-4022-b7d7-01d5d48385b3 service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Received event network-vif-plugged-72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-36dcb641-9987-48b2-8559-f53a8358716f req-2b849f06-d449-4022-b7d7-01d5d48385b3 service nova] Acquiring lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-36dcb641-9987-48b2-8559-f53a8358716f req-2b849f06-d449-4022-b7d7-01d5d48385b3 service nova] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-36dcb641-9987-48b2-8559-f53a8358716f req-2b849f06-d449-4022-b7d7-01d5d48385b3 service nova] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-36dcb641-9987-48b2-8559-f53a8358716f req-2b849f06-d449-4022-b7d7-01d5d48385b3 service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] No waiting events found dispatching network-vif-plugged-72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:08:15 user nova-compute[75469]: WARNING nova.compute.manager [req-36dcb641-9987-48b2-8559-f53a8358716f req-2b849f06-d449-4022-b7d7-01d5d48385b3 service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Received unexpected event network-vif-plugged-72a9a068-1244-4e81-a5cc-d72092e3280f for instance with vm_state building and task_state spawning.
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26135373261373534', 'path': '/dev/sde'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135373261373534', 'path': '/dev/sde'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.877s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG nova.objects.instance [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'flavor' on Instance uuid 48eb80db-7b57-42cf-9555-41909fd0c59f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2907fe8e-5af2-43bb-b686-cc66efec6358]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:08:16 user nova-compute[75469]: No targets found.
Nov 14 05:08:16 user nova-compute[75469]: iSNS:
Nov 14 05:08:16 user nova-compute[75469]: No targets found.
Nov 14 05:08:16 user nova-compute[75469]: STATIC:
Nov 14 05:08:16 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e
Nov 14 05:08:16 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:16 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:16 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5
Nov 14 05:08:16 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:16 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:16 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088
Nov 14 05:08:16 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:16 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:16 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce
Nov 14 05:08:16 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:16 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:16 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:08:16 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:16 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:16 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a
Nov 14 05:08:16 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:16 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:16 user nova-compute[75469]: FIRMWARE:
Nov 14 05:08:16 user nova-compute[75469]: No targets found.
Nov 14 05:08:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:08:16 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:08:16 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:08:16 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:08:16 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:08:16 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:08:16 user nova-compute[75469]:   <serial>b261a421-0388-400b-b538-d0c24dd71dce</serial>
Nov 14 05:08:16 user nova-compute[75469]: </disk>
Nov 14 05:08:16 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2c6a32-0293-4b72-a3f0-5ef0d9b97c2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bb277e-f709-4809-b373-81514d61efd2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:16 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:16 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:16 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:16 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:16 user nova-compute[75469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)
Nov 14 05:08:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:16 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:16 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:16 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:16 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:16 user nova-compute[75469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)
Nov 14 05:08:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f5fd90>, {}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Disconnecting from: [] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== disconnect_volume: return (954ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:08:16 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Deleting instance files /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf_del
Nov 14 05:08:16 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Deletion of /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf_del complete
Nov 14 05:08:16 user nova-compute[75469]: INFO nova.virt.block_device [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Booting with volume fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 at /dev/vdb
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.utils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d50a70d-5a46-4b28-b3f3-0e6cfe5dd4d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38932b1-5947-4749-9c79-639866ef20d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[97de2dc3-9378-4430-8d20-7ba160a94e93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4053ad-236c-4b52-9031-666a353a9ce6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:08:16 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f445b2e-ff4f-46d9-a5e4-8d70c5ad3e1f]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG os_brick.utils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Updating existing volume attachment record: e5a4f161-4302-469b-96ee-6e5d29f9a385 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] No VIF found with MAC fa:16:3e:42:b2:61, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:08:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2186b742-dd8b-48db-b61a-622ca01bf8ac tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.453s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-e11267b0-e5b3-46ed-b826-d6a8fac7c8d8 req-bad1317d-ba0c-4537-9995-30e2ec267a52 service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Received event network-vif-plugged-72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e11267b0-e5b3-46ed-b826-d6a8fac7c8d8 req-bad1317d-ba0c-4537-9995-30e2ec267a52 service nova] Acquiring lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e11267b0-e5b3-46ed-b826-d6a8fac7c8d8 req-bad1317d-ba0c-4537-9995-30e2ec267a52 service nova] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e11267b0-e5b3-46ed-b826-d6a8fac7c8d8 req-bad1317d-ba0c-4537-9995-30e2ec267a52 service nova] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-e11267b0-e5b3-46ed-b826-d6a8fac7c8d8 req-bad1317d-ba0c-4537-9995-30e2ec267a52 service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] No waiting events found dispatching network-vif-plugged-72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:08:17 user nova-compute[75469]: WARNING nova.compute.manager [req-e11267b0-e5b3-46ed-b826-d6a8fac7c8d8 req-bad1317d-ba0c-4537-9995-30e2ec267a52 service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Received unexpected event network-vif-plugged-72a9a068-1244-4e81-a5cc-d72092e3280f for instance with vm_state building and task_state spawning.
Nov 14 05:08:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:08:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:08:17 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Instance spawned successfully.
Nov 14 05:08:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:08:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:08:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:08:17 user nova-compute[75469]: INFO nova.compute.manager [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 14 05:08:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:08:18 user nova-compute[75469]: INFO nova.compute.manager [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Took 16.49 seconds to build instance.
Nov 14 05:08:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-50934cf6-031e-4216-9487-0059a10ff84f tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.589s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "48eb80db-7b57-42cf-9555-41909fd0c59f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:18 user nova-compute[75469]: INFO nova.compute.manager [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Detaching volume b261a421-0388-400b-b538-d0c24dd71dce
Nov 14 05:08:18 user nova-compute[75469]: INFO nova.virt.block_device [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Attempting to driver detach volume b261a421-0388-400b-b538-d0c24dd71dce from mountpoint /dev/vdb
Nov 14 05:08:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Attempting to detach device vdb from instance 48eb80db-7b57-42cf-9555-41909fd0c59f from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:08:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:08:18 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:08:18 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:08:18 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:08:18 user nova-compute[75469]:   <serial>b261a421-0388-400b-b538-d0c24dd71dce</serial>
Nov 14 05:08:18 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:08:18 user nova-compute[75469]: </disk>
Nov 14 05:08:18 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:08:18 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully detached device vdb from instance 48eb80db-7b57-42cf-9555-41909fd0c59f from the persistent domain config.
Nov 14 05:08:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48eb80db-7b57-42cf-9555-41909fd0c59f from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:08:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:08:18 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:08:18 user nova-compute[75469]:   <source dev="/dev/sde"/>
Nov 14 05:08:18 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:08:18 user nova-compute[75469]:   <serial>b261a421-0388-400b-b538-d0c24dd71dce</serial>
Nov 14 05:08:18 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:08:18 user nova-compute[75469]: </disk>
Nov 14 05:08:18 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:08:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48eb80db-7b57-42cf-9555-41909fd0c59f {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:08:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:08:19 user nova-compute[75469]: INFO nova.compute.manager [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] instance snapshotting
Nov 14 05:08:19 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Beginning live snapshot process
Nov 14 05:08:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json -f qcow2 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json -f qcow2 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8grw71bn/1c02dbfb98874ba6a729225dd1513457.delta 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8grw71bn/1c02dbfb98874ba6a729225dd1513457.delta 1073741824" returned: 0 in 0.049s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:20 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 05:08:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 05:08:21 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 05:08:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:08:21 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Creating image(s)
Nov 14 05:08:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "/opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "/opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8grw71bn/1c02dbfb98874ba6a729225dd1513457.delta /opt/stack/data/nova/instances/snapshots/tmp8grw71bn/1c02dbfb98874ba6a729225dd1513457 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.214s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.218s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk 1073741824" returned: 0 in 0.070s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8grw71bn/1c02dbfb98874ba6a729225dd1513457.delta /opt/stack/data/nova/instances/snapshots/tmp8grw71bn/1c02dbfb98874ba6a729225dd1513457" returned: 0 in 0.462s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Snapshot extracted, beginning image upload
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.227s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Cannot resize image /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Ensure instance console log exists: /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Start _get_guest_xml network_info=[{"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'e5a4f161-4302-469b-96ee-6e5d29f9a385', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyVnfLjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a8ffecbb-5de1-4425-adc5-77fab650b8bf', 'attached_at': '', 'detached_at': '', 'volume_id': 'fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 'serial': 'fcb5090a-f0b5-4a17-bdf8-12dce9765cf2'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:08:22 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 05:08:22 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.objects.instance [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8ffecbb-5de1-4425-adc5-77fab650b8bf {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyVnfLjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:22 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:22 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:22 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f90af52-2613-4c53-a444-bfd80ae05d2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:08:22 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb60b7c-9658-4763-8f1a-e22e8b15fd10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2] added
Nov 14 05:08:22 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a7ca61-eee2-4fb6-a09b-177a224d9253]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa1971f-b4fc-4085-a711-ead824dc23ac]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FyVnfLjx {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FyVnfLjx" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28e7c5f-f31c-462c-a826-54fff03f001b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FyVnfLjx'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80a011a-7205-44fc-a3ae-cd56cbcd8db1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f955b632-8b33-41e8-946f-a2a8a3457601]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:22 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:22 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:22 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:22 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:22 user nova-compute[75469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)
Nov 14 05:08:22 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:22 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:22 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:22 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:22 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:22 user nova-compute[75469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)
Nov 14 05:08:22 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0ada44-109b-4943-89b5-faa93f36e02a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260]
Nov 14 05:08:23 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260] successful.
Nov 14 05:08:23 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0849bd2-32b4-4e03-b78d-973a3d2a671c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f33ed6-40ef-4e9c-9757-222570e54297]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:23 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)
Nov 14 05:08:23 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:23 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] HCTL ('39', '-', '-', 0) found on session 45 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1f3724-c743-4bea-8ce8-9487e1663dde]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching for a device in session 45 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:08:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyVnfLjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23331653735316231', 'path': '/dev/sdh'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331653735316231', 'path': '/dev/sdh'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T05:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-371085368',display_name='tempest-ServerActionsTestOtherA-server-978815786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-371085368',id=35,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEGTjKqJtkw69dGeCfipwwu89LWWzigSdhele3X3LHWVxYIXIwfNlKlD+XZzmRdKkrwU9RQT/IBBp6eeTDS+MZRGWNM5TH35v1mw59FjYgHxSYncm9QShDeNALd4AjFug==',key_name='tempest-keypair-1304959429',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-s900r63d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:08:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a8ffecbb-5de1-4425-adc5-77fab650b8bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:08:24 user nova-compute[75469]:   <uuid>a8ffecbb-5de1-4425-adc5-77fab650b8bf</uuid>
Nov 14 05:08:24 user nova-compute[75469]:   <name>instance-00000023</name>
Nov 14 05:08:24 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:08:24 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:08:24 user nova-compute[75469]:   <metadata>
Nov 14 05:08:24 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:08:24 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:08:24 user nova-compute[75469]:       <nova:name>tempest-ServerActionsTestOtherA-server-978815786</nova:name>
Nov 14 05:08:24 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:08:22</nova:creationTime>
Nov 14 05:08:24 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:08:24 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:08:24 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:08:24 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:08:24 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:08:24 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:08:24 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:08:24 user nova-compute[75469]:       <nova:owner>
Nov 14 05:08:24 user nova-compute[75469]:         <nova:user uuid="fedd54c65b8a4adbba761994474cdd9b">tempest-ServerActionsTestOtherA-2099137527-project-member</nova:user>
Nov 14 05:08:24 user nova-compute[75469]:         <nova:project uuid="ac925f78df5d4746a9bd603db3613839">tempest-ServerActionsTestOtherA-2099137527</nova:project>
Nov 14 05:08:24 user nova-compute[75469]:       </nova:owner>
Nov 14 05:08:24 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:08:24 user nova-compute[75469]:       <nova:ports>
Nov 14 05:08:24 user nova-compute[75469]:         <nova:port uuid="5b19d7a7-df11-4a7b-b994-e62b40a91600">
Nov 14 05:08:24 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 05:08:24 user nova-compute[75469]:         </nova:port>
Nov 14 05:08:24 user nova-compute[75469]:       </nova:ports>
Nov 14 05:08:24 user nova-compute[75469]:     </nova:instance>
Nov 14 05:08:24 user nova-compute[75469]:   </metadata>
Nov 14 05:08:24 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:08:24 user nova-compute[75469]:     <system>
Nov 14 05:08:24 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:08:24 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:08:24 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:08:24 user nova-compute[75469]:       <entry name="serial">a8ffecbb-5de1-4425-adc5-77fab650b8bf</entry>
Nov 14 05:08:24 user nova-compute[75469]:       <entry name="uuid">a8ffecbb-5de1-4425-adc5-77fab650b8bf</entry>
Nov 14 05:08:24 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:08:24 user nova-compute[75469]:     </system>
Nov 14 05:08:24 user nova-compute[75469]:   </sysinfo>
Nov 14 05:08:24 user nova-compute[75469]:   <os>
Nov 14 05:08:24 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:08:24 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:08:24 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:08:24 user nova-compute[75469]:   </os>
Nov 14 05:08:24 user nova-compute[75469]:   <features>
Nov 14 05:08:24 user nova-compute[75469]:     <acpi/>
Nov 14 05:08:24 user nova-compute[75469]:     <apic/>
Nov 14 05:08:24 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:08:24 user nova-compute[75469]:   </features>
Nov 14 05:08:24 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:08:24 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:08:24 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:08:24 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:08:24 user nova-compute[75469]:   </clock>
Nov 14 05:08:24 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:08:24 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:08:24 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:08:24 user nova-compute[75469]:   </cpu>
Nov 14 05:08:24 user nova-compute[75469]:   <devices>
Nov 14 05:08:24 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:08:24 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:08:24 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk"/>
Nov 14 05:08:24 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:08:24 user nova-compute[75469]:     </disk>
Nov 14 05:08:24 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:08:24 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:08:24 user nova-compute[75469]:       <source dev="/dev/sdh"/>
Nov 14 05:08:24 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 05:08:24 user nova-compute[75469]:       <serial>fcb5090a-f0b5-4a17-bdf8-12dce9765cf2</serial>
Nov 14 05:08:24 user nova-compute[75469]:     </disk>
Nov 14 05:08:24 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:08:24 user nova-compute[75469]:       <mac address="fa:16:3e:c5:30:3f"/>
Nov 14 05:08:24 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:08:24 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:08:24 user nova-compute[75469]:       <target dev="tap5b19d7a7-df"/>
Nov 14 05:08:24 user nova-compute[75469]:     </interface>
Nov 14 05:08:24 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:08:24 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/console.log" append="off"/>
Nov 14 05:08:24 user nova-compute[75469]:     </serial>
Nov 14 05:08:24 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:08:24 user nova-compute[75469]:     <video>
Nov 14 05:08:24 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:08:24 user nova-compute[75469]:     </video>
Nov 14 05:08:24 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:08:24 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:08:24 user nova-compute[75469]:     </rng>
Nov 14 05:08:24 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:08:24 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:08:24 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:08:24 user nova-compute[75469]:     </memballoon>
Nov 14 05:08:24 user nova-compute[75469]:   </devices>
Nov 14 05:08:24 user nova-compute[75469]: </domain>
Nov 14 05:08:24 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T05:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-371085368',display_name='tempest-ServerActionsTestOtherA-server-978815786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-371085368',id=35,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEGTjKqJtkw69dGeCfipwwu89LWWzigSdhele3X3LHWVxYIXIwfNlKlD+XZzmRdKkrwU9RQT/IBBp6eeTDS+MZRGWNM5TH35v1mw59FjYgHxSYncm9QShDeNALd4AjFug==',key_name='tempest-keypair-1304959429',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-s900r63d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:08:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a8ffecbb-5de1-4425-adc5-77fab650b8bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG os_vif [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3469cdd2-7268-5ff9-823c-96b5f8987cb1', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b19d7a7-df, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b19d7a7-df, col_values=(('qos', UUID('96d83e08-e69c-4deb-8d4c-c38b4ab8188a')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b19d7a7-df, col_values=(('external_ids', {'iface-id': '5b19d7a7-df11-4a7b-b994-e62b40a91600', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:30:3f', 'vm-uuid': 'a8ffecbb-5de1-4425-adc5-77fab650b8bf'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:24 user nova-compute[75469]: INFO os_vif [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df')
Nov 14 05:08:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:08:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No VIF found with MAC fa:16:3e:c5:30:3f, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:08:24 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Snapshot image upload complete
Nov 14 05:08:24 user nova-compute[75469]: INFO nova.compute.manager [None req-47b956d5-fe50-4900-ae41-16902911b9a4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Took 5.44 seconds to snapshot the instance on the hypervisor.
Nov 14 05:08:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-78c59c3f-c6d4-48ca-838e-fa4f82286a87 req-9c4ac8e7-b9d6-4ec0-9b9c-6c7a03b493dd service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-78c59c3f-c6d4-48ca-838e-fa4f82286a87 req-9c4ac8e7-b9d6-4ec0-9b9c-6c7a03b493dd service nova] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-78c59c3f-c6d4-48ca-838e-fa4f82286a87 req-9c4ac8e7-b9d6-4ec0-9b9c-6c7a03b493dd service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-78c59c3f-c6d4-48ca-838e-fa4f82286a87 req-9c4ac8e7-b9d6-4ec0-9b9c-6c7a03b493dd service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-78c59c3f-c6d4-48ca-838e-fa4f82286a87 req-9c4ac8e7-b9d6-4ec0-9b9c-6c7a03b493dd service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] No waiting events found dispatching network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:08:25 user nova-compute[75469]: WARNING nova.compute.manager [req-78c59c3f-c6d4-48ca-838e-fa4f82286a87 req-9c4ac8e7-b9d6-4ec0-9b9c-6c7a03b493dd service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received unexpected event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 05:08:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:08:27 user nova-compute[75469]: INFO nova.compute.claims [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Claim successful on node user
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:08:27 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Instance spawned successfully.
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-2a33a66d-b438-4944-9c86-4d7114fb1200 req-218e1644-b5e9-4ef3-a7ee-5cba7a4b4819 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2a33a66d-b438-4944-9c86-4d7114fb1200 req-218e1644-b5e9-4ef3-a7ee-5cba7a4b4819 service nova] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2a33a66d-b438-4944-9c86-4d7114fb1200 req-218e1644-b5e9-4ef3-a7ee-5cba7a4b4819 service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2a33a66d-b438-4944-9c86-4d7114fb1200 req-218e1644-b5e9-4ef3-a7ee-5cba7a4b4819 service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-2a33a66d-b438-4944-9c86-4d7114fb1200 req-218e1644-b5e9-4ef3-a7ee-5cba7a4b4819 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] No waiting events found dispatching network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:08:27 user nova-compute[75469]: WARNING nova.compute.manager [req-2a33a66d-b438-4944-9c86-4d7114fb1200 req-218e1644-b5e9-4ef3-a7ee-5cba7a4b4819 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received unexpected event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:08:27 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.097s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG nova.objects.instance [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75469) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:08:28 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:08:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0183a30d-b102-4678-aa3e-72210d4fb502 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG nova.policy [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aee00a8861b64c90aef13e13ca17b8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a227a14762d241479644c6bfdf340bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:08:28 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Creating image(s)
Nov 14 05:08:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "/opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "/opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "3966fe6da1ff32544ff453932e1181c4b05a2ece" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "3966fe6da1ff32544ff453932e1181c4b05a2ece" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece.part --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Successfully created port: c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece.part --force-share --output=json" returned: 0 in 0.201s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG nova.virt.images [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] f891e1de-0f87-4c58-b6d7-7aa478799c83 was qcow2, converting to raw {{(pid=75469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece.part /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece.converted {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece.part /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece.converted" returned: 0 in 0.301s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece.converted --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Successfully updated port: c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "3966fe6da1ff32544ff453932e1181c4b05a2ece" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.553s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-35598bd4-ef9b-4e14-8e4b-c53465fe95e3 req-0927c024-36c9-4268-87db-b0d3cc40d3bc service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received event network-changed-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-35598bd4-ef9b-4e14-8e4b-c53465fe95e3 req-0927c024-36c9-4268-87db-b0d3cc40d3bc service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Refreshing instance network info cache due to event network-changed-c79b50cb-44ce-424a-8370-a840da4b45bd. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-35598bd4-ef9b-4e14-8e4b-c53465fe95e3 req-0927c024-36c9-4268-87db-b0d3cc40d3bc service nova] Acquiring lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-35598bd4-ef9b-4e14-8e4b-c53465fe95e3 req-0927c024-36c9-4268-87db-b0d3cc40d3bc service nova] Acquired lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG nova.network.neutron [req-35598bd4-ef9b-4e14-8e4b-c53465fe95e3 req-0927c024-36c9-4268-87db-b0d3cc40d3bc service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Refreshing network info cache for port c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:08:29 user nova-compute[75469]: DEBUG nova.network.neutron [req-35598bd4-ef9b-4e14-8e4b-c53465fe95e3 req-0927c024-36c9-4268-87db-b0d3cc40d3bc service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "3966fe6da1ff32544ff453932e1181c4b05a2ece" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "3966fe6da1ff32544ff453932e1181c4b05a2ece" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.network.neutron [req-35598bd4-ef9b-4e14-8e4b-c53465fe95e3 req-0927c024-36c9-4268-87db-b0d3cc40d3bc service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-35598bd4-ef9b-4e14-8e4b-c53465fe95e3 req-0927c024-36c9-4268-87db-b0d3cc40d3bc service nova] Releasing lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquired lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece --force-share --output=json" returned: 0 in 0.189s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece,backing_fmt=raw /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece,backing_fmt=raw /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk 1073741824" returned: 0 in 0.066s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "3966fe6da1ff32544ff453932e1181c4b05a2ece" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Ensure instance console log exists: /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Updating instance_info_cache with network_info: [{"id": "c79b50cb-44ce-424a-8370-a840da4b45bd", "address": "fa:16:3e:fd:10:48", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b50cb-44", "ovs_interfaceid": "c79b50cb-44ce-424a-8370-a840da4b45bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Releasing lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Instance network_info: |[{"id": "c79b50cb-44ce-424a-8370-a840da4b45bd", "address": "fa:16:3e:fd:10:48", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b50cb-44", "ovs_interfaceid": "c79b50cb-44ce-424a-8370-a840da4b45bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Start _get_guest_xml network_info=[{"id": "c79b50cb-44ce-424a-8370-a840da4b45bd", "address": "fa:16:3e:fd:10:48", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b50cb-44", "ovs_interfaceid": "c79b50cb-44ce-424a-8370-a840da4b45bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='82eeae7621ccb0266e730db20799783f',container_format='bare',created_at=2023-11-14T05:08:19Z,direct_url=<?>,disk_format='qcow2',id=f891e1de-0f87-4c58-b6d7-7aa478799c83,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1955270023',owner='a227a14762d241479644c6bfdf340bee',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T05:08:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'f891e1de-0f87-4c58-b6d7-7aa478799c83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:08:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:08:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='82eeae7621ccb0266e730db20799783f',container_format='bare',created_at=2023-11-14T05:08:19Z,direct_url=<?>,disk_format='qcow2',id=f891e1de-0f87-4c58-b6d7-7aa478799c83,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1955270023',owner='a227a14762d241479644c6bfdf340bee',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T05:08:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1475331482',display_name='tempest-TestStampPattern-server-1475331482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1475331482',id=40,image_ref='f891e1de-0f87-4c58-b6d7-7aa478799c83',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIbprXKukdzTIGKQy5CdrYJsNjT3KMcr1m2DCPZxsN4W045qdvgMW40zZ6YaNfSahpFUhbzXXXrWBXhMt7BGmhkttHYyfVM1bsmzIIYbrZC/EfH3ShlUu1reGi0vZx7ZQ==',key_name='tempest-TestStampPattern-1132364811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a227a14762d241479644c6bfdf340bee',ramdisk_id='',reservation_id='r-ahwq8au4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='87874095-a320-4445-8dd3-b7b259764dfa',image_min_disk='1',image_min_ram='0',image_owner_id='a227a14762d241479644c6bfdf340bee',image_owner_project_name='tempest-TestStampPattern-1299350604',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1299350604-project-member',image_user_id='aee00a8861b64c90aef13e13ca17b8d0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1299350604',owner_user_name='tempest-TestStampPattern-1299350604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:08:28Z,user_data=None,user_id='aee00a8861b64c90aef13e13ca17b8d0',uuid=eb5e944a-cdd5-49e7-b17e-67ae91ba8413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c79b50cb-44ce-424a-8370-a840da4b45bd", "address": "fa:16:3e:fd:10:48", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b50cb-44", "ovs_interfaceid": "c79b50cb-44ce-424a-8370-a840da4b45bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converting VIF {"id": "c79b50cb-44ce-424a-8370-a840da4b45bd", "address": "fa:16:3e:fd:10:48", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b50cb-44", "ovs_interfaceid": "c79b50cb-44ce-424a-8370-a840da4b45bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:10:48,bridge_name='br-int',has_traffic_filtering=True,id=c79b50cb-44ce-424a-8370-a840da4b45bd,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b50cb-44') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.objects.instance [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lazy-loading 'pci_devices' on Instance uuid eb5e944a-cdd5-49e7-b17e-67ae91ba8413 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:08:30 user nova-compute[75469]:   <uuid>eb5e944a-cdd5-49e7-b17e-67ae91ba8413</uuid>
Nov 14 05:08:30 user nova-compute[75469]:   <name>instance-00000028</name>
Nov 14 05:08:30 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:08:30 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:08:30 user nova-compute[75469]:   <metadata>
Nov 14 05:08:30 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:08:30 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:08:30 user nova-compute[75469]:       <nova:name>tempest-TestStampPattern-server-1475331482</nova:name>
Nov 14 05:08:30 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:08:30</nova:creationTime>
Nov 14 05:08:30 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:08:30 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:08:30 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:08:30 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:08:30 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:08:30 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:08:30 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:08:30 user nova-compute[75469]:       <nova:owner>
Nov 14 05:08:30 user nova-compute[75469]:         <nova:user uuid="aee00a8861b64c90aef13e13ca17b8d0">tempest-TestStampPattern-1299350604-project-member</nova:user>
Nov 14 05:08:30 user nova-compute[75469]:         <nova:project uuid="a227a14762d241479644c6bfdf340bee">tempest-TestStampPattern-1299350604</nova:project>
Nov 14 05:08:30 user nova-compute[75469]:       </nova:owner>
Nov 14 05:08:30 user nova-compute[75469]:       <nova:root type="image" uuid="f891e1de-0f87-4c58-b6d7-7aa478799c83"/>
Nov 14 05:08:30 user nova-compute[75469]:       <nova:ports>
Nov 14 05:08:30 user nova-compute[75469]:         <nova:port uuid="c79b50cb-44ce-424a-8370-a840da4b45bd">
Nov 14 05:08:30 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 05:08:30 user nova-compute[75469]:         </nova:port>
Nov 14 05:08:30 user nova-compute[75469]:       </nova:ports>
Nov 14 05:08:30 user nova-compute[75469]:     </nova:instance>
Nov 14 05:08:30 user nova-compute[75469]:   </metadata>
Nov 14 05:08:30 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:08:30 user nova-compute[75469]:     <system>
Nov 14 05:08:30 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:08:30 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:08:30 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:08:30 user nova-compute[75469]:       <entry name="serial">eb5e944a-cdd5-49e7-b17e-67ae91ba8413</entry>
Nov 14 05:08:30 user nova-compute[75469]:       <entry name="uuid">eb5e944a-cdd5-49e7-b17e-67ae91ba8413</entry>
Nov 14 05:08:30 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:08:30 user nova-compute[75469]:     </system>
Nov 14 05:08:30 user nova-compute[75469]:   </sysinfo>
Nov 14 05:08:30 user nova-compute[75469]:   <os>
Nov 14 05:08:30 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:08:30 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:08:30 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:08:30 user nova-compute[75469]:   </os>
Nov 14 05:08:30 user nova-compute[75469]:   <features>
Nov 14 05:08:30 user nova-compute[75469]:     <acpi/>
Nov 14 05:08:30 user nova-compute[75469]:     <apic/>
Nov 14 05:08:30 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:08:30 user nova-compute[75469]:   </features>
Nov 14 05:08:30 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:08:30 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:08:30 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:08:30 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:08:30 user nova-compute[75469]:   </clock>
Nov 14 05:08:30 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:08:30 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:08:30 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:08:30 user nova-compute[75469]:   </cpu>
Nov 14 05:08:30 user nova-compute[75469]:   <devices>
Nov 14 05:08:30 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:08:30 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:08:30 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk"/>
Nov 14 05:08:30 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:08:30 user nova-compute[75469]:     </disk>
Nov 14 05:08:30 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:08:30 user nova-compute[75469]:       <mac address="fa:16:3e:fd:10:48"/>
Nov 14 05:08:30 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:08:30 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:08:30 user nova-compute[75469]:       <target dev="tapc79b50cb-44"/>
Nov 14 05:08:30 user nova-compute[75469]:     </interface>
Nov 14 05:08:30 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:08:30 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/console.log" append="off"/>
Nov 14 05:08:30 user nova-compute[75469]:     </serial>
Nov 14 05:08:30 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:08:30 user nova-compute[75469]:     <video>
Nov 14 05:08:30 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:08:30 user nova-compute[75469]:     </video>
Nov 14 05:08:30 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:08:30 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:08:30 user nova-compute[75469]:     </rng>
Nov 14 05:08:30 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:08:30 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:08:30 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:08:30 user nova-compute[75469]:     </memballoon>
Nov 14 05:08:30 user nova-compute[75469]:   </devices>
Nov 14 05:08:30 user nova-compute[75469]: </domain>
Nov 14 05:08:30 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1475331482',display_name='tempest-TestStampPattern-server-1475331482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1475331482',id=40,image_ref='f891e1de-0f87-4c58-b6d7-7aa478799c83',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIbprXKukdzTIGKQy5CdrYJsNjT3KMcr1m2DCPZxsN4W045qdvgMW40zZ6YaNfSahpFUhbzXXXrWBXhMt7BGmhkttHYyfVM1bsmzIIYbrZC/EfH3ShlUu1reGi0vZx7ZQ==',key_name='tempest-TestStampPattern-1132364811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a227a14762d241479644c6bfdf340bee',ramdisk_id='',reservation_id='r-ahwq8au4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='87874095-a320-4445-8dd3-b7b259764dfa',image_min_disk='1',image_min_ram='0',image_owner_id='a227a14762d241479644c6bfdf340bee',image_owner_project_name='tempest-TestStampPattern-1299350604',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1299350604-project-member',image_user_id='aee00a8861b64c90aef13e13ca17b8d0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1299350604',owner_user_name='tempest-TestStampPattern-1299350604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:08:28Z,user_data=None,user_id='aee00a8861b64c90aef13e13ca17b8d0',uuid=eb5e944a-cdd5-49e7-b17e-67ae91ba8413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c79b50cb-44ce-424a-8370-a840da4b45bd", "address": "fa:16:3e:fd:10:48", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b50cb-44", "ovs_interfaceid": "c79b50cb-44ce-424a-8370-a840da4b45bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converting VIF {"id": "c79b50cb-44ce-424a-8370-a840da4b45bd", "address": "fa:16:3e:fd:10:48", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b50cb-44", "ovs_interfaceid": "c79b50cb-44ce-424a-8370-a840da4b45bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:10:48,bridge_name='br-int',has_traffic_filtering=True,id=c79b50cb-44ce-424a-8370-a840da4b45bd,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b50cb-44') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG os_vif [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:10:48,bridge_name='br-int',has_traffic_filtering=True,id=c79b50cb-44ce-424a-8370-a840da4b45bd,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b50cb-44') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef40e007-84d7-5ba7-8c84-7b395be23603', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc79b50cb-44, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc79b50cb-44, col_values=(('qos', UUID('5978b891-5fb0-421d-b1d7-d9149002401a')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc79b50cb-44, col_values=(('external_ids', {'iface-id': 'c79b50cb-44ce-424a-8370-a840da4b45bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:10:48', 'vm-uuid': 'eb5e944a-cdd5-49e7-b17e-67ae91ba8413'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:30 user nova-compute[75469]: INFO os_vif [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:10:48,bridge_name='br-int',has_traffic_filtering=True,id=c79b50cb-44ce-424a-8370-a840da4b45bd,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b50cb-44')
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:08:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] No VIF found with MAC fa:16:3e:fd:10:48, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:08:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-e372d240-9928-40ae-8549-54c13cbe7711 req-e5855189-f755-40f7-b039-63e03ea60d23 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received event network-vif-plugged-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e372d240-9928-40ae-8549-54c13cbe7711 req-e5855189-f755-40f7-b039-63e03ea60d23 service nova] Acquiring lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e372d240-9928-40ae-8549-54c13cbe7711 req-e5855189-f755-40f7-b039-63e03ea60d23 service nova] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e372d240-9928-40ae-8549-54c13cbe7711 req-e5855189-f755-40f7-b039-63e03ea60d23 service nova] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-e372d240-9928-40ae-8549-54c13cbe7711 req-e5855189-f755-40f7-b039-63e03ea60d23 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] No waiting events found dispatching network-vif-plugged-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:08:32 user nova-compute[75469]: WARNING nova.compute.manager [req-e372d240-9928-40ae-8549-54c13cbe7711 req-e5855189-f755-40f7-b039-63e03ea60d23 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received unexpected event network-vif-plugged-c79b50cb-44ce-424a-8370-a840da4b45bd for instance with vm_state building and task_state spawning.
Nov 14 05:08:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:08:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:08:34 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Instance spawned successfully.
Nov 14 05:08:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:08:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:08:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:08:34 user nova-compute[75469]: INFO nova.compute.manager [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 14 05:08:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:08:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-11621418-865e-42b8-a9e6-b64073dcf706 req-a4063fce-106d-4615-a54b-ce2ac0390740 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received event network-vif-plugged-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-11621418-865e-42b8-a9e6-b64073dcf706 req-a4063fce-106d-4615-a54b-ce2ac0390740 service nova] Acquiring lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-11621418-865e-42b8-a9e6-b64073dcf706 req-a4063fce-106d-4615-a54b-ce2ac0390740 service nova] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-11621418-865e-42b8-a9e6-b64073dcf706 req-a4063fce-106d-4615-a54b-ce2ac0390740 service nova] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-11621418-865e-42b8-a9e6-b64073dcf706 req-a4063fce-106d-4615-a54b-ce2ac0390740 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] No waiting events found dispatching network-vif-plugged-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:08:34 user nova-compute[75469]: WARNING nova.compute.manager [req-11621418-865e-42b8-a9e6-b64073dcf706 req-a4063fce-106d-4615-a54b-ce2ac0390740 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received unexpected event network-vif-plugged-c79b50cb-44ce-424a-8370-a840da4b45bd for instance with vm_state building and task_state spawning.
Nov 14 05:08:34 user nova-compute[75469]: INFO nova.compute.manager [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Took 6.88 seconds to build instance.
Nov 14 05:08:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a217d7f6-18fa-453b-ac18-cd90eaa151dc tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.979s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:38 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 48eb80db-7b57-42cf-9555-41909fd0c59f is timed out.
Nov 14 05:08:38 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully detached device vdb from instance 48eb80db-7b57-42cf-9555-41909fd0c59f from the live domain config.
Nov 14 05:08:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTrDjAxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:38 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:08:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[140efa12-3135-42ec-b5be-f09fab8ba40e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:08:38 user nova-compute[75469]: No targets found.
Nov 14 05:08:38 user nova-compute[75469]: iSNS:
Nov 14 05:08:38 user nova-compute[75469]: No targets found.
Nov 14 05:08:38 user nova-compute[75469]: STATIC:
Nov 14 05:08:38 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e
Nov 14 05:08:38 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:38 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:38 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5
Nov 14 05:08:38 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:38 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:38 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088
Nov 14 05:08:38 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:38 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:38 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce
Nov 14 05:08:38 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:38 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:38 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:08:38 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:38 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:38 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a
Nov 14 05:08:38 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:38 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:38 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2
Nov 14 05:08:38 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:38 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:38 user nova-compute[75469]: FIRMWARE:
Nov 14 05:08:38 user nova-compute[75469]: No targets found.
Nov 14 05:08:38 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:08:38 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:08:38 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb62508-303c-46ae-af15-e36355dce63c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b49d9d-9d98-442b-9b46-aaa7c15fcb4b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:38 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce (non-flash)
Nov 14 05:08:38 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:38 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f5fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce'): ({'sde'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Removing single pathed devices sde {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:08:38 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a33d997-48a5-4100-bebc-99445a69eaba]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[686848d3-57f5-4e28-a564-c1a076121faf]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Flushing IO for device /dev/sde {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb4c163-86c7-46aa-9ba3-ee8378db3389]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[970246c1-0fbd-4e94-b9d0-e7c64628892a]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] SCSI volumes sde have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdf5854-5820-4658-ade2-4fb3a300f108]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabef9d0-e75e-45c9-930f-4c67f8a373c2]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce, portal: 172.16.0.220,3260]
Nov 14 05:08:39 user nova-compute[75469]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce, portal: 172.16.0.220,3260] successful.
Nov 14 05:08:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b261a421-0388-400b-b538-d0c24dd71dce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bee166-ba87-405b-b06d-9b7c0673c1d2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] <== disconnect_volume: return (350ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:08:39 user nova-compute[75469]: DEBUG nova.objects.instance [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'flavor' on Instance uuid 48eb80db-7b57-42cf-9555-41909fd0c59f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:08:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-352e5da8-b07c-44a2-8ed0-71334ecb8a79 tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.691s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "c07c6b3f-e748-4a36-a018-2336000b716d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:53 user nova-compute[75469]: INFO nova.compute.manager [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Terminating instance
Nov 14 05:08:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-3972f364-f55d-4d4a-9d33-515d1dfb5059 req-d6bdb08e-c420-4e1d-808a-29e0a33f0a29 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-unplugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3972f364-f55d-4d4a-9d33-515d1dfb5059 req-d6bdb08e-c420-4e1d-808a-29e0a33f0a29 service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3972f364-f55d-4d4a-9d33-515d1dfb5059 req-d6bdb08e-c420-4e1d-808a-29e0a33f0a29 service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3972f364-f55d-4d4a-9d33-515d1dfb5059 req-d6bdb08e-c420-4e1d-808a-29e0a33f0a29 service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-3972f364-f55d-4d4a-9d33-515d1dfb5059 req-d6bdb08e-c420-4e1d-808a-29e0a33f0a29 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-unplugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:08:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-3972f364-f55d-4d4a-9d33-515d1dfb5059 req-d6bdb08e-c420-4e1d-808a-29e0a33f0a29 service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-unplugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:08:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Instance destroyed successfully.
Nov 14 05:08:54 user nova-compute[75469]: DEBUG nova.objects.instance [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'resources' on Instance uuid c07c6b3f-e748-4a36-a018-2336000b716d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:03:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-96373400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-96373400',id=31,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:05:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-6ra00e0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:07:07Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=c07c6b3f-e748-4a36-a018-2336000b716d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "address": "fa:16:3e:e0:e9:2e", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e47e54c-fc", "ovs_interfaceid": "9e47e54c-fc40-4577-bb19-f8f9c6a73a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e9:2e,bridge_name='br-int',has_traffic_filtering=True,id=9e47e54c-fc40-4577-bb19-f8f9c6a73a68,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e47e54c-fc') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_vif [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e9:2e,bridge_name='br-int',has_traffic_filtering=True,id=9e47e54c-fc40-4577-bb19-f8f9c6a73a68,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e47e54c-fc') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e47e54c-fc, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=531758a2-53f2-40a9-80ab-3084ff6dd4e9) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:54 user nova-compute[75469]: INFO os_vif [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e9:2e,bridge_name='br-int',has_traffic_filtering=True,id=9e47e54c-fc40-4577-bb19-f8f9c6a73a68,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e47e54c-fc')
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCGaAeQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:08:54 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6946f6-f1e5-48db-a0b8-521e903153a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:08:54 user nova-compute[75469]: No targets found.
Nov 14 05:08:54 user nova-compute[75469]: iSNS:
Nov 14 05:08:54 user nova-compute[75469]: No targets found.
Nov 14 05:08:54 user nova-compute[75469]: STATIC:
Nov 14 05:08:54 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e
Nov 14 05:08:54 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:54 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:54 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5
Nov 14 05:08:54 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:54 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:54 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088
Nov 14 05:08:54 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:54 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:54 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:08:54 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:54 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:54 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a
Nov 14 05:08:54 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:54 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:54 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2
Nov 14 05:08:54 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:08:54 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:08:54 user nova-compute[75469]: FIRMWARE:
Nov 14 05:08:54 user nova-compute[75469]: No targets found.
Nov 14 05:08:54 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:08:54 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:08:54 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[80772aab-68bf-4c89-852f-0ca90c154db6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5417eff-0e7d-46df-8d01-2725b212f80d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:54 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:54 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:54 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:54 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:54 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:54 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:08:54 user nova-compute[75469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 (non-flash)
Nov 14 05:08:54 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:08:54 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:08:54 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:08:54 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:08:54 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708eeacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c329a160-d540-4824-af49-19d9c848445f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[854e2bb0-06da-4b80-8afe-3d39153baa95]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4fe266-f36e-409c-8432-5574c0580533]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3b686a-a3f4-4ff6-a04a-0605671d8ec7]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b383559-bda6-4978-9f60-1fa8a76b2de4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8cf043-15be-46dc-bb12-c6ed9e65b6ac]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5, portal: 172.16.0.220,3260]
Nov 14 05:08:54 user nova-compute[75469]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5, portal: 172.16.0.220,3260] successful.
Nov 14 05:08:54 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c09ea236-173a-42bb-8248-490aef5baba5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24b7183-d558-4694-a73b-4acd653381d0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] <== disconnect_volume: return (384ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:08:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Deleting instance files /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d_del
Nov 14 05:08:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Deletion of /opt/stack/data/nova/instances/c07c6b3f-e748-4a36-a018-2336000b716d_del complete
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: INFO nova.compute.manager [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:08:55 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Took 0.41 seconds to deallocate network for instance.
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-c5671671-3ca8-441b-9c0d-8218e5307b9c req-cc9aba6b-d063-4e12-a7bc-c247ec8ed7ef service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c5671671-3ca8-441b-9c0d-8218e5307b9c req-cc9aba6b-d063-4e12-a7bc-c247ec8ed7ef service nova] Acquiring lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c5671671-3ca8-441b-9c0d-8218e5307b9c req-cc9aba6b-d063-4e12-a7bc-c247ec8ed7ef service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c5671671-3ca8-441b-9c0d-8218e5307b9c req-cc9aba6b-d063-4e12-a7bc-c247ec8ed7ef service nova] Lock "c07c6b3f-e748-4a36-a018-2336000b716d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-c5671671-3ca8-441b-9c0d-8218e5307b9c req-cc9aba6b-d063-4e12-a7bc-c247ec8ed7ef service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] No waiting events found dispatching network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:08:55 user nova-compute[75469]: WARNING nova.compute.manager [req-c5671671-3ca8-441b-9c0d-8218e5307b9c req-cc9aba6b-d063-4e12-a7bc-c247ec8ed7ef service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received unexpected event network-vif-plugged-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 for instance with vm_state active and task_state deleting.
Nov 14 05:08:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-c5671671-3ca8-441b-9c0d-8218e5307b9c req-cc9aba6b-d063-4e12-a7bc-c247ec8ed7ef service nova] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Received event network-vif-deleted-9e47e54c-fc40-4577-bb19-f8f9c6a73a68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:08:55 user nova-compute[75469]: INFO nova.compute.manager [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: c07c6b3f-e748-4a36-a018-2336000b716d] Took 0.77 seconds to detach 1 volumes for instance.
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:08:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Error from libvirt while getting description of instance-0000001f: [Error Code 42] Domain not found: no domain with matching uuid 'c07c6b3f-e748-4a36-a018-2336000b716d' (instance-0000001f): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c07c6b3f-e748-4a36-a018-2336000b716d' (instance-0000001f)
Nov 14 05:08:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:56 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Deleted allocations for instance c07c6b3f-e748-4a36-a018-2336000b716d
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-288dd385-ca10-4266-8fd7-7b4db2ec3f38 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "c07c6b3f-e748-4a36-a018-2336000b716d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.119s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:08:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:08:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=7316MB free_disk=24.61618423461914GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a48d1c5d-db49-4609-9ca4-21f4578d8943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 87874095-a320-4445-8dd3-b7b259764dfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 9a0c1e54-59d5-4890-9c6c-3bc34928bb65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a8ffecbb-5de1-4425-adc5-77fab650b8bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 48eb80db-7b57-42cf-9555-41909fd0c59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 699c7785-d380-47b4-8ff3-b67e059af4ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance e74a9e8f-2e86-4de9-9d39-5192cf5763c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2048496d-3733-4ca5-b27a-f6be129b7c0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance eb5e944a-cdd5-49e7-b17e-67ae91ba8413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:08:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:08:58 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:08:58 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:08:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:08:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:08:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updating instance_info_cache with network_info: [{"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:09:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:09:01 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:09:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 80741f98-11b9-4a80-a51b-39d5ce4e44f5 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 929364ea-9d56-41ff-a393-8abd7df60eec {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid a48d1c5d-db49-4609-9ca4-21f4578d8943 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid d742ff9e-3b9f-4d3f-9825-3d3361765b24 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 87874095-a320-4445-8dd3-b7b259764dfa {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 9a0c1e54-59d5-4890-9c6c-3bc34928bb65 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 48eb80db-7b57-42cf-9555-41909fd0c59f {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 699c7785-d380-47b4-8ff3-b67e059af4ae {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid e74a9e8f-2e86-4de9-9d39-5192cf5763c5 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 2048496d-3733-4ca5-b27a-f6be129b7c0b {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid eb5e944a-cdd5-49e7-b17e-67ae91ba8413 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid a8ffecbb-5de1-4425-adc5-77fab650b8bf {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "929364ea-9d56-41ff-a393-8abd7df60eec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "a48d1c5d-db49-4609-9ca4-21f4578d8943" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "87874095-a320-4445-8dd3-b7b259764dfa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "87874095-a320-4445-8dd3-b7b259764dfa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "48eb80db-7b57-42cf-9555-41909fd0c59f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "699c7785-d380-47b4-8ff3-b67e059af4ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "2048496d-3733-4ca5-b27a-f6be129b7c0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "929364ea-9d56-41ff-a393-8abd7df60eec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "87874095-a320-4445-8dd3-b7b259764dfa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "48eb80db-7b57-42cf-9555-41909fd0c59f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:08 user nova-compute[75469]: INFO nova.compute.manager [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Terminating instance
Nov 14 05:09:08 user nova-compute[75469]: DEBUG nova.compute.manager [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:09:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-25a25bca-e5ac-4836-a41a-8e8e8b11258c req-06ba5174-ad38-460f-b3d4-bb5420c2b608 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Received event network-vif-unplugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-25a25bca-e5ac-4836-a41a-8e8e8b11258c req-06ba5174-ad38-460f-b3d4-bb5420c2b608 service nova] Acquiring lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-25a25bca-e5ac-4836-a41a-8e8e8b11258c req-06ba5174-ad38-460f-b3d4-bb5420c2b608 service nova] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-25a25bca-e5ac-4836-a41a-8e8e8b11258c req-06ba5174-ad38-460f-b3d4-bb5420c2b608 service nova] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-25a25bca-e5ac-4836-a41a-8e8e8b11258c req-06ba5174-ad38-460f-b3d4-bb5420c2b608 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] No waiting events found dispatching network-vif-unplugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-25a25bca-e5ac-4836-a41a-8e8e8b11258c req-06ba5174-ad38-460f-b3d4-bb5420c2b608 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Received event network-vif-unplugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:09 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Instance destroyed successfully.
Nov 14 05:09:09 user nova-compute[75469]: DEBUG nova.objects.instance [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lazy-loading 'resources' on Instance uuid 48eb80db-7b57-42cf-9555-41909fd0c59f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1385426198',display_name='tempest-AttachVolumeNegativeTest-server-1385426198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1385426198',id=36,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8C2ugwBDhFzafdgL0QQfrvSncmj+XJ6b5QoyV+Ns3yipa8C1M7+UmJkFDoxw2UHI267BzMqJ1VlGZ9jaIHwM8DIZQ/urRjQXkepfcPzILFu9/lOUXOXcjzVMZ142d7RA==',key_name='tempest-keypair-1255671859',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c59f6cc7c2254d4ba2581a445e02075f',ramdisk_id='',reservation_id='r-tvzzxb8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1768463318',owner_user_name='tempest-AttachVolumeNegativeTest-1768463318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:06:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98acc8e0c8044cca5d6f7a35b3bdad0',uuid=48eb80db-7b57-42cf-9555-41909fd0c59f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "address": "fa:16:3e:42:b2:61", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abc82fa-51", "ovs_interfaceid": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converting VIF {"id": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "address": "fa:16:3e:42:b2:61", "network": {"id": "00abd4a9-77d1-40f5-95b0-d6fcef87c434", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-482756413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59f6cc7c2254d4ba2581a445e02075f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abc82fa-51", "ovs_interfaceid": "9abc82fa-5119-4b74-897d-39cf6f5c3064", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:b2:61,bridge_name='br-int',has_traffic_filtering=True,id=9abc82fa-5119-4b74-897d-39cf6f5c3064,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abc82fa-51') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG os_vif [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:b2:61,bridge_name='br-int',has_traffic_filtering=True,id=9abc82fa-5119-4b74-897d-39cf6f5c3064,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abc82fa-51') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9abc82fa-51, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=010126ef-ff9f-4d30-a753-898134f80121) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:09 user nova-compute[75469]: INFO os_vif [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:b2:61,bridge_name='br-int',has_traffic_filtering=True,id=9abc82fa-5119-4b74-897d-39cf6f5c3064,network=Network(00abd4a9-77d1-40f5-95b0-d6fcef87c434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abc82fa-51')
Nov 14 05:09:09 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Deleting instance files /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f_del
Nov 14 05:09:09 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Deletion of /opt/stack/data/nova/instances/48eb80db-7b57-42cf-9555-41909fd0c59f_del complete
Nov 14 05:09:09 user nova-compute[75469]: INFO nova.compute.manager [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 05:09:09 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:09:09 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:09:10 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Took 0.78 seconds to deallocate network for instance.
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Acquiring lock "699c7785-d380-47b4-8ff3-b67e059af4ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Acquiring lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:10 user nova-compute[75469]: INFO nova.compute.manager [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Terminating instance
Nov 14 05:09:10 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-45651fa5-2829-4585-abc9-9fbfdfb19822 req-1ece7f16-9fc6-4706-9836-c64b5eaccc01 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Received event network-vif-deleted-9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-226f3871-92b6-4d81-a0a2-6ea305c8f86a req-78b528bc-0b3e-4a9e-843c-361f98029547 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Received event network-vif-unplugged-a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-226f3871-92b6-4d81-a0a2-6ea305c8f86a req-78b528bc-0b3e-4a9e-843c-361f98029547 service nova] Acquiring lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-226f3871-92b6-4d81-a0a2-6ea305c8f86a req-78b528bc-0b3e-4a9e-843c-361f98029547 service nova] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-226f3871-92b6-4d81-a0a2-6ea305c8f86a req-78b528bc-0b3e-4a9e-843c-361f98029547 service nova] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-226f3871-92b6-4d81-a0a2-6ea305c8f86a req-78b528bc-0b3e-4a9e-843c-361f98029547 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] No waiting events found dispatching network-vif-unplugged-a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-226f3871-92b6-4d81-a0a2-6ea305c8f86a req-78b528bc-0b3e-4a9e-843c-361f98029547 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Received event network-vif-unplugged-a3afeaa6-666a-4d2d-8864-95e08a476641 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:10 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Deleted allocations for instance 48eb80db-7b57-42cf-9555-41909fd0c59f
Nov 14 05:09:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-151e811c-28e6-487b-92eb-89e135d1486b tempest-AttachVolumeNegativeTest-1768463318 tempest-AttachVolumeNegativeTest-1768463318-project-member] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.268s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:11 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Instance destroyed successfully.
Nov 14 05:09:11 user nova-compute[75469]: DEBUG nova.objects.instance [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lazy-loading 'resources' on Instance uuid 699c7785-d380-47b4-8ff3-b67e059af4ae {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2078356054',display_name='tempest-VolumesActionsTest-instance-2078356054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2078356054',id=37,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:07:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73d6d718b86b444ab9a48aff480d3333',ramdisk_id='',reservation_id='r-olat6t92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1628468413',owner_user_name='tempest-VolumesActionsTest-1628468413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:07:24Z,user_data=None,user_id='fb365160669b4e51a79fbb9ffba2dbc5',uuid=699c7785-d380-47b4-8ff3-b67e059af4ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3afeaa6-666a-4d2d-8864-95e08a476641", "address": "fa:16:3e:14:4d:68", "network": {"id": "233d1673-adbe-4fdd-8e04-19bdf75e9480", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629333611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d6d718b86b444ab9a48aff480d3333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3afeaa6-66", "ovs_interfaceid": "a3afeaa6-666a-4d2d-8864-95e08a476641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Converting VIF {"id": "a3afeaa6-666a-4d2d-8864-95e08a476641", "address": "fa:16:3e:14:4d:68", "network": {"id": "233d1673-adbe-4fdd-8e04-19bdf75e9480", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629333611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d6d718b86b444ab9a48aff480d3333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3afeaa6-66", "ovs_interfaceid": "a3afeaa6-666a-4d2d-8864-95e08a476641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4d:68,bridge_name='br-int',has_traffic_filtering=True,id=a3afeaa6-666a-4d2d-8864-95e08a476641,network=Network(233d1673-adbe-4fdd-8e04-19bdf75e9480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3afeaa6-66') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG os_vif [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4d:68,bridge_name='br-int',has_traffic_filtering=True,id=a3afeaa6-666a-4d2d-8864-95e08a476641,network=Network(233d1673-adbe-4fdd-8e04-19bdf75e9480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3afeaa6-66') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-c3b305ce-84b9-4554-958e-87906eba888a req-8d4d5bf8-82e9-4fbb-b248-7c11b6b196c2 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Received event network-vif-plugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c3b305ce-84b9-4554-958e-87906eba888a req-8d4d5bf8-82e9-4fbb-b248-7c11b6b196c2 service nova] Acquiring lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c3b305ce-84b9-4554-958e-87906eba888a req-8d4d5bf8-82e9-4fbb-b248-7c11b6b196c2 service nova] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c3b305ce-84b9-4554-958e-87906eba888a req-8d4d5bf8-82e9-4fbb-b248-7c11b6b196c2 service nova] Lock "48eb80db-7b57-42cf-9555-41909fd0c59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-c3b305ce-84b9-4554-958e-87906eba888a req-8d4d5bf8-82e9-4fbb-b248-7c11b6b196c2 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] No waiting events found dispatching network-vif-plugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:09:11 user nova-compute[75469]: WARNING nova.compute.manager [req-c3b305ce-84b9-4554-958e-87906eba888a req-8d4d5bf8-82e9-4fbb-b248-7c11b6b196c2 service nova] [instance: 48eb80db-7b57-42cf-9555-41909fd0c59f] Received unexpected event network-vif-plugged-9abc82fa-5119-4b74-897d-39cf6f5c3064 for instance with vm_state deleted and task_state None.
Nov 14 05:09:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3afeaa6-66, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4896eab0-41d7-46e4-9be1-4ed5295e94f7) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:11 user nova-compute[75469]: INFO os_vif [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4d:68,bridge_name='br-int',has_traffic_filtering=True,id=a3afeaa6-666a-4d2d-8864-95e08a476641,network=Network(233d1673-adbe-4fdd-8e04-19bdf75e9480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3afeaa6-66')
Nov 14 05:09:11 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Deleting instance files /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae_del
Nov 14 05:09:11 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Deletion of /opt/stack/data/nova/instances/699c7785-d380-47b4-8ff3-b67e059af4ae_del complete
Nov 14 05:09:11 user nova-compute[75469]: INFO nova.compute.manager [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 05:09:11 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:09:11 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Took 0.45 seconds to deallocate network for instance.
Nov 14 05:09:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:12 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Deleted allocations for instance 699c7785-d380-47b4-8ff3-b67e059af4ae
Nov 14 05:09:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d5748514-d823-4ab5-86d2-74db7f95d334 tempest-VolumesActionsTest-1628468413 tempest-VolumesActionsTest-1628468413-project-member] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.793s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-e421c06f-baa8-4f26-91f0-017eecdc9bf1 req-328e02d2-d475-4046-8147-ebdcc9d99552 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Received event network-vif-deleted-a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Received event network-vif-plugged-a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] Acquiring lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] Lock "699c7785-d380-47b4-8ff3-b67e059af4ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] No waiting events found dispatching network-vif-plugged-a3afeaa6-666a-4d2d-8864-95e08a476641 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:09:12 user nova-compute[75469]: WARNING nova.compute.manager [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] [instance: 699c7785-d380-47b4-8ff3-b67e059af4ae] Received unexpected event network-vif-plugged-a3afeaa6-666a-4d2d-8864-95e08a476641 for instance with vm_state deleted and task_state None.
Nov 14 05:09:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-changed-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Refreshing instance network info cache due to event network-changed-c3c21b15-f830-41d9-a5b6-242a097ac43d. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] Acquiring lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] Acquired lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:09:12 user nova-compute[75469]: DEBUG nova.network.neutron [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Refreshing network info cache for port c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:09:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:13 user nova-compute[75469]: INFO nova.compute.manager [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Shelve offloading
Nov 14 05:09:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:13 user nova-compute[75469]: DEBUG nova.network.neutron [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updated VIF entry in instance network info cache for port c3c21b15-f830-41d9-a5b6-242a097ac43d. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:09:13 user nova-compute[75469]: DEBUG nova.network.neutron [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating instance_info_cache with network_info: [{"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:09:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6db9d3b9-6625-4950-9cdd-89f618636434 req-3c416818-b0d8-40ec-bfc6-0fe560ba95f5 service nova] Releasing lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:09:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:13 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Instance destroyed successfully.
Nov 14 05:09:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:09:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:09:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquired lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:09:13 user nova-compute[75469]: DEBUG nova.network.neutron [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG nova.network.neutron [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating instance_info_cache with network_info: [{"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Releasing lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-unplugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] No waiting events found dispatching network-vif-unplugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:09:14 user nova-compute[75469]: WARNING nova.compute.manager [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received unexpected event network-vif-unplugged-c3c21b15-f830-41d9-a5b6-242a097ac43d for instance with vm_state active and task_state shelving.
Nov 14 05:09:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] No waiting events found dispatching network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:09:14 user nova-compute[75469]: WARNING nova.compute.manager [req-c9f621d6-776c-418d-9daa-37491b03a5f9 req-c94b4f75-193a-4c7b-a557-ffc613751f0f service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received unexpected event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d for instance with vm_state active and task_state shelving.
Nov 14 05:09:14 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Instance destroyed successfully.
Nov 14 05:09:14 user nova-compute[75469]: DEBUG nova.objects.instance [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lazy-loading 'resources' on Instance uuid e74a9e8f-2e86-4de9-9d39-5192cf5763c5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116243024',display_name='tempest-TestShelveInstance-server-2116243024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116243024',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0Qas8BH6l6FqQNvGoTG+Iy1AxUhx83WtDJZDKWmaIXfJT4oouE9iO/yf9IlPc8wEtovlgdDqLYXUh2SCgAu1eJ4kPF7B3On30+g0vXPcFEBA/m60Gz6wl1aUtqlaIm5w==',key_name='tempest-TestShelveInstance-848916377',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e916ef90975b40bdb9a887d02e4770dd',ramdisk_id='',reservation_id='r-qjebm1o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1973652568',owner_user_name='tempest-TestShelveInstance-1973652568-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:07:32Z,user_data=None,user_id='6212f1c3188246c6b94e3ad485d6174f',uuid=e74a9e8f-2e86-4de9-9d39-5192cf5763c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converting VIF {"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG os_vif [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3c21b15-f8, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12aed8bc-b91d-4172-8fb9-e7f96ef07c49) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:14 user nova-compute[75469]: INFO os_vif [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8')
Nov 14 05:09:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnfNGRUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:09:14 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:09:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ca3de4-8d2d-4057-a1fb-d78dcf253336]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:09:14 user nova-compute[75469]: No targets found.
Nov 14 05:09:14 user nova-compute[75469]: iSNS:
Nov 14 05:09:14 user nova-compute[75469]: No targets found.
Nov 14 05:09:14 user nova-compute[75469]: STATIC:
Nov 14 05:09:14 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e
Nov 14 05:09:14 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:09:14 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:09:14 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088
Nov 14 05:09:14 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:09:14 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:09:14 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:09:14 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:09:14 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:09:14 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a
Nov 14 05:09:14 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:09:14 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:09:14 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2
Nov 14 05:09:14 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:09:14 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:09:14 user nova-compute[75469]: FIRMWARE:
Nov 14 05:09:14 user nova-compute[75469]: No targets found.
Nov 14 05:09:14 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:09:14 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:09:14 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5251ffea-92ed-4dcc-b46b-ca1cf6b20707]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a4c495-24ab-4a4d-bcf4-afa9c8089ed0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:09:14 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:09:14 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:09:14 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:09:14 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:09:14 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:09:14 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:09:14 user nova-compute[75469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:09:14 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:09:14 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:09:14 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c5e4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088'): ({'sdf'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Removing single pathed devices sdf {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:09:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19b5061-8144-47c0-9439-39d6c50db758]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1199240-f18b-45c5-afae-a8930b0297e9]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Flushing IO for device /dev/sdf {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[635338cd-3050-4791-838d-4fe1be09ca92]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cbf7d5-3924-4155-adb4-00f5804c30fb]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] SCSI volumes sdf have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b8a759-b1c4-4b81-aa99-23b71d0668dd]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7998c2b6-7214-4150-a7e6-23d27ea1de32]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260]
Nov 14 05:09:15 user nova-compute[75469]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260] successful.
Nov 14 05:09:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2267081c-6c27-4adb-a9a7-ecf2e51c7554]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] <== disconnect_volume: return (335ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:09:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:09:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Deleting instance files /opt/stack/data/nova/instances/e74a9e8f-2e86-4de9-9d39-5192cf5763c5_del
Nov 14 05:09:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Deletion of /opt/stack/data/nova/instances/e74a9e8f-2e86-4de9-9d39-5192cf5763c5_del complete
Nov 14 05:09:16 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Deleted allocations for instance e74a9e8f-2e86-4de9-9d39-5192cf5763c5
Nov 14 05:09:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG nova.objects.instance [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lazy-loading 'numa_topology' on Instance uuid e74a9e8f-2e86-4de9-9d39-5192cf5763c5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG nova.objects.base [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Object Instance<e74a9e8f-2e86-4de9-9d39-5192cf5763c5> lazy-loaded attributes: resources,numa_topology {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-646bb1f1-13ac-4b92-ac69-27fce9913562 req-e38a98e3-ac7e-4d27-b4b3-db86e859e53e service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-changed-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-646bb1f1-13ac-4b92-ac69-27fce9913562 req-e38a98e3-ac7e-4d27-b4b3-db86e859e53e service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Refreshing instance network info cache due to event network-changed-c3c21b15-f830-41d9-a5b6-242a097ac43d. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-646bb1f1-13ac-4b92-ac69-27fce9913562 req-e38a98e3-ac7e-4d27-b4b3-db86e859e53e service nova] Acquiring lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-646bb1f1-13ac-4b92-ac69-27fce9913562 req-e38a98e3-ac7e-4d27-b4b3-db86e859e53e service nova] Acquired lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG nova.network.neutron [req-646bb1f1-13ac-4b92-ac69-27fce9913562 req-e38a98e3-ac7e-4d27-b4b3-db86e859e53e service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Refreshing network info cache for port c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-23c0befc-e849-4b89-b3e5-6c0592cfbf07 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.513s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-646bb1f1-13ac-4b92-ac69-27fce9913562 req-e38a98e3-ac7e-4d27-b4b3-db86e859e53e service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updated VIF entry in instance network info cache for port c3c21b15-f830-41d9-a5b6-242a097ac43d. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:09:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-646bb1f1-13ac-4b92-ac69-27fce9913562 req-e38a98e3-ac7e-4d27-b4b3-db86e859e53e service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating instance_info_cache with network_info: [{"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": null, "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:09:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-646bb1f1-13ac-4b92-ac69-27fce9913562 req-e38a98e3-ac7e-4d27-b4b3-db86e859e53e service nova] Releasing lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:09:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:09:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:09:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:09:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:09:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:09:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "a48d1c5d-db49-4609-9ca4-21f4578d8943" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:44 user nova-compute[75469]: INFO nova.compute.manager [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Terminating instance
Nov 14 05:09:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-baa4fa53-0ecd-4848-95db-459b9e65c594 req-7266bb89-9c55-4402-b5da-6f69e76f85c5 service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Received event network-vif-unplugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-baa4fa53-0ecd-4848-95db-459b9e65c594 req-7266bb89-9c55-4402-b5da-6f69e76f85c5 service nova] Acquiring lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-baa4fa53-0ecd-4848-95db-459b9e65c594 req-7266bb89-9c55-4402-b5da-6f69e76f85c5 service nova] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-baa4fa53-0ecd-4848-95db-459b9e65c594 req-7266bb89-9c55-4402-b5da-6f69e76f85c5 service nova] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-baa4fa53-0ecd-4848-95db-459b9e65c594 req-7266bb89-9c55-4402-b5da-6f69e76f85c5 service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] No waiting events found dispatching network-vif-unplugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-baa4fa53-0ecd-4848-95db-459b9e65c594 req-7266bb89-9c55-4402-b5da-6f69e76f85c5 service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Received event network-vif-unplugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:09:44 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Instance destroyed successfully.
Nov 14 05:09:44 user nova-compute[75469]: DEBUG nova.objects.instance [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'resources' on Instance uuid a48d1c5d-db49-4609-9ca4-21f4578d8943 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-305368857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-305368857',id=25,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:00:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-hfauh5b3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:02:18Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=a48d1c5d-db49-4609-9ca4-21f4578d8943,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "address": "fa:16:3e:4f:d1:31", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa47bcc-04", "ovs_interfaceid": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "address": "fa:16:3e:4f:d1:31", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa47bcc-04", "ovs_interfaceid": "0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d1:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa47bcc-04') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG os_vif [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d1:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa47bcc-04') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0aa47bcc-04, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e6bc387-2123-49f8-ab31-211a1fd2d84e) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:44 user nova-compute[75469]: INFO os_vif [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d1:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa47bcc-04')
Nov 14 05:09:44 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Deleting instance files /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943_del
Nov 14 05:09:44 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Deletion of /opt/stack/data/nova/instances/a48d1c5d-db49-4609-9ca4-21f4578d8943_del complete
Nov 14 05:09:45 user nova-compute[75469]: INFO nova.compute.manager [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 05:09:45 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:09:45 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:09:45 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:09:45 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:09:45 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Took 0.46 seconds to deallocate network for instance.
Nov 14 05:09:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-e3defbbe-dfd1-4a81-9b8a-c44e17d71420 req-220c9728-428f-4753-9fc0-96befead5884 service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Received event network-vif-deleted-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:45 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:09:45 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:09:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:45 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Deleted allocations for instance a48d1c5d-db49-4609-9ca4-21f4578d8943
Nov 14 05:09:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f435e0f4-bcc9-4545-a651-c830ea787284 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.885s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-8e663adf-f22b-4626-ad07-923d61365ac5 req-5f39e9a2-82cf-4b36-8c6a-23a9d3eba0df service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Received event network-vif-plugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8e663adf-f22b-4626-ad07-923d61365ac5 req-5f39e9a2-82cf-4b36-8c6a-23a9d3eba0df service nova] Acquiring lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8e663adf-f22b-4626-ad07-923d61365ac5 req-5f39e9a2-82cf-4b36-8c6a-23a9d3eba0df service nova] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8e663adf-f22b-4626-ad07-923d61365ac5 req-5f39e9a2-82cf-4b36-8c6a-23a9d3eba0df service nova] Lock "a48d1c5d-db49-4609-9ca4-21f4578d8943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-8e663adf-f22b-4626-ad07-923d61365ac5 req-5f39e9a2-82cf-4b36-8c6a-23a9d3eba0df service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] No waiting events found dispatching network-vif-plugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:09:46 user nova-compute[75469]: WARNING nova.compute.manager [req-8e663adf-f22b-4626-ad07-923d61365ac5 req-5f39e9a2-82cf-4b36-8c6a-23a9d3eba0df service nova] [instance: a48d1c5d-db49-4609-9ca4-21f4578d8943] Received unexpected event network-vif-plugged-0aa47bcc-04f3-4aeb-afba-fbac53dcb4d0 for instance with vm_state deleted and task_state None.
Nov 14 05:09:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-9261a755-9381-4122-abe2-da7aa6f863c5 req-1b578e75-e3ac-405a-84cc-3f330b2145ab service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Received event network-changed-72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-9261a755-9381-4122-abe2-da7aa6f863c5 req-1b578e75-e3ac-405a-84cc-3f330b2145ab service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Refreshing instance network info cache due to event network-changed-72a9a068-1244-4e81-a5cc-d72092e3280f. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9261a755-9381-4122-abe2-da7aa6f863c5 req-1b578e75-e3ac-405a-84cc-3f330b2145ab service nova] Acquiring lock "refresh_cache-2048496d-3733-4ca5-b27a-f6be129b7c0b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9261a755-9381-4122-abe2-da7aa6f863c5 req-1b578e75-e3ac-405a-84cc-3f330b2145ab service nova] Acquired lock "refresh_cache-2048496d-3733-4ca5-b27a-f6be129b7c0b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG nova.network.neutron [req-9261a755-9381-4122-abe2-da7aa6f863c5 req-1b578e75-e3ac-405a-84cc-3f330b2145ab service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Refreshing network info cache for port 72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG nova.network.neutron [req-9261a755-9381-4122-abe2-da7aa6f863c5 req-1b578e75-e3ac-405a-84cc-3f330b2145ab service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Updated VIF entry in instance network info cache for port 72a9a068-1244-4e81-a5cc-d72092e3280f. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG nova.network.neutron [req-9261a755-9381-4122-abe2-da7aa6f863c5 req-1b578e75-e3ac-405a-84cc-3f330b2145ab service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Updating instance_info_cache with network_info: [{"id": "72a9a068-1244-4e81-a5cc-d72092e3280f", "address": "fa:16:3e:58:bc:28", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a9a068-12", "ovs_interfaceid": "72a9a068-1244-4e81-a5cc-d72092e3280f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9261a755-9381-4122-abe2-da7aa6f863c5 req-1b578e75-e3ac-405a-84cc-3f330b2145ab service nova] Releasing lock "refresh_cache-2048496d-3733-4ca5-b27a-f6be129b7c0b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "2048496d-3733-4ca5-b27a-f6be129b7c0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:52 user nova-compute[75469]: INFO nova.compute.manager [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Terminating instance
Nov 14 05:09:52 user nova-compute[75469]: DEBUG nova.compute.manager [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:09:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-f8b5dec0-a1e6-4c1f-8349-84e008034a71 req-5d6a5762-61a0-4bab-b05c-b38bf367f82e service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Received event network-vif-unplugged-72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f8b5dec0-a1e6-4c1f-8349-84e008034a71 req-5d6a5762-61a0-4bab-b05c-b38bf367f82e service nova] Acquiring lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f8b5dec0-a1e6-4c1f-8349-84e008034a71 req-5d6a5762-61a0-4bab-b05c-b38bf367f82e service nova] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f8b5dec0-a1e6-4c1f-8349-84e008034a71 req-5d6a5762-61a0-4bab-b05c-b38bf367f82e service nova] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-f8b5dec0-a1e6-4c1f-8349-84e008034a71 req-5d6a5762-61a0-4bab-b05c-b38bf367f82e service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] No waiting events found dispatching network-vif-unplugged-72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-f8b5dec0-a1e6-4c1f-8349-84e008034a71 req-5d6a5762-61a0-4bab-b05c-b38bf367f82e service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Received event network-vif-unplugged-72a9a068-1244-4e81-a5cc-d72092e3280f for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:53 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Instance destroyed successfully.
Nov 14 05:09:53 user nova-compute[75469]: DEBUG nova.objects.instance [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'resources' on Instance uuid 2048496d-3733-4ca5-b27a-f6be129b7c0b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1350518321',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1350518321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1350518321',id=39,image_ref='32de5403-110d-422f-9ef0-666fc4983f07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPfKpGWMXAuLcucSH4PsyBKfbT7MK9RVuXaV+6BOVOGhamgSw/2pl0Z8lYCc1EEaGK39WbZ/ksSMulG6KZo7QQLeF0z3+tMKv7K/CGXuKukpvdLCutXGuOOaf8TNr7/rQ==',key_name='tempest-keypair-1732056113',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-eo1bzjgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-43343925',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=2048496d-3733-4ca5-b27a-f6be129b7c0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72a9a068-1244-4e81-a5cc-d72092e3280f", "address": "fa:16:3e:58:bc:28", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a9a068-12", "ovs_interfaceid": "72a9a068-1244-4e81-a5cc-d72092e3280f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "72a9a068-1244-4e81-a5cc-d72092e3280f", "address": "fa:16:3e:58:bc:28", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a9a068-12", "ovs_interfaceid": "72a9a068-1244-4e81-a5cc-d72092e3280f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:bc:28,bridge_name='br-int',has_traffic_filtering=True,id=72a9a068-1244-4e81-a5cc-d72092e3280f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a9a068-12') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_vif [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:bc:28,bridge_name='br-int',has_traffic_filtering=True,id=72a9a068-1244-4e81-a5cc-d72092e3280f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a9a068-12') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72a9a068-12, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e522a89-bb4a-45e0-9432-54a2f84d416a) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:09:53 user nova-compute[75469]: INFO os_vif [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:bc:28,bridge_name='br-int',has_traffic_filtering=True,id=72a9a068-1244-4e81-a5cc-d72092e3280f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a9a068-12')
Nov 14 05:09:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqLbiNCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:09:53 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9dc75c-8e34-4578-9272-3f7495e8d087]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:09:53 user nova-compute[75469]: No targets found.
Nov 14 05:09:53 user nova-compute[75469]: iSNS:
Nov 14 05:09:53 user nova-compute[75469]: No targets found.
Nov 14 05:09:53 user nova-compute[75469]: STATIC:
Nov 14 05:09:53 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e
Nov 14 05:09:53 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:09:53 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:09:53 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:09:53 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:09:53 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:09:53 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a
Nov 14 05:09:53 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:09:53 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:09:53 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2
Nov 14 05:09:53 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:09:53 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:09:53 user nova-compute[75469]: FIRMWARE:
Nov 14 05:09:53 user nova-compute[75469]: No targets found.
Nov 14 05:09:53 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:09:53 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:09:53 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[046c7a77-e23c-4d65-9b04-39c1310e8c14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd907929-5523-414b-b32f-f252ef01c7fd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:09:53 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:09:53 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:09:53 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:09:53 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:09:53 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:09:53 user nova-compute[75469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e (non-flash)
Nov 14 05:09:53 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:09:53 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708eeb640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e'): ({'sdg'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Removing single pathed devices sdg {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07f6fb9-546b-4c8c-a057-2a2f18613a0e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e503b503-43c4-42f5-bba7-c55a959f0265]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flushing IO for device /dev/sdg {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ee3324-fd47-46b2-8915-b89ad5160bae]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1e5ffb-4f2f-4237-aa69-1531262b0ede]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] SCSI volumes sdg have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23163663461626537', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c3da6dbd', '/dev/disk/by-id/scsi-1SCST_BIOc3da6dbd-1cf4abe74b7d43c6') {{(pid=85531) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04d5c1c-90be-43e6-ab5a-bc65dcece4b8]: (4, None) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6327bf57-612f-4439-86b9-0643b9249420]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[050cb207-4d6e-4ec6-aa07-8d0d3d371558]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e, portal: 172.16.0.220,3260]
Nov 14 05:09:53 user nova-compute[75469]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e, portal: 172.16.0.220,3260] successful.
Nov 14 05:09:53 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:09:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151f7a9f-3545-4445-83a9-a25acb53351e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:54 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab43a8dc-90eb-4e73-88c4-623fd5b90c38]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:09:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:09:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:09:54 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== disconnect_volume: return (337ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:09:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:09:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Deleting instance files /opt/stack/data/nova/instances/2048496d-3733-4ca5-b27a-f6be129b7c0b_del
Nov 14 05:09:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Deletion of /opt/stack/data/nova/instances/2048496d-3733-4ca5-b27a-f6be129b7c0b_del complete
Nov 14 05:09:54 user nova-compute[75469]: INFO nova.compute.manager [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 05:09:54 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:09:54 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:09:54 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:09:54 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:09:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-82a850c1-bff1-4590-86eb-8702d4a251f0 req-4827e755-979e-47c7-8b23-c19f71a0b9db service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Received event network-vif-deleted-72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:54 user nova-compute[75469]: INFO nova.compute.manager [req-82a850c1-bff1-4590-86eb-8702d4a251f0 req-4827e755-979e-47c7-8b23-c19f71a0b9db service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Neutron deleted interface 72a9a068-1244-4e81-a5cc-d72092e3280f; detaching it from the instance and deleting it from the info cache
Nov 14 05:09:54 user nova-compute[75469]: DEBUG nova.network.neutron [req-82a850c1-bff1-4590-86eb-8702d4a251f0 req-4827e755-979e-47c7-8b23-c19f71a0b9db service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:09:54 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Took 0.75 seconds to deallocate network for instance.
Nov 14 05:09:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-82a850c1-bff1-4590-86eb-8702d4a251f0 req-4827e755-979e-47c7-8b23-c19f71a0b9db service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Detach interface failed, port_id=72a9a068-1244-4e81-a5cc-d72092e3280f, reason: Instance 2048496d-3733-4ca5-b27a-f6be129b7c0b could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-bbd5ad83-426d-47d9-bcbf-781a61ea68d7 req-c5f65a03-d238-47d8-951a-71d900454282 service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Received event network-vif-plugged-72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bbd5ad83-426d-47d9-bcbf-781a61ea68d7 req-c5f65a03-d238-47d8-951a-71d900454282 service nova] Acquiring lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bbd5ad83-426d-47d9-bcbf-781a61ea68d7 req-c5f65a03-d238-47d8-951a-71d900454282 service nova] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bbd5ad83-426d-47d9-bcbf-781a61ea68d7 req-c5f65a03-d238-47d8-951a-71d900454282 service nova] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-bbd5ad83-426d-47d9-bcbf-781a61ea68d7 req-c5f65a03-d238-47d8-951a-71d900454282 service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] No waiting events found dispatching network-vif-plugged-72a9a068-1244-4e81-a5cc-d72092e3280f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:09:55 user nova-compute[75469]: WARNING nova.compute.manager [req-bbd5ad83-426d-47d9-bcbf-781a61ea68d7 req-c5f65a03-d238-47d8-951a-71d900454282 service nova] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Received unexpected event network-vif-plugged-72a9a068-1244-4e81-a5cc-d72092e3280f for instance with vm_state active and task_state deleting.
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:55 user nova-compute[75469]: INFO nova.compute.manager [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 05:09:55 user nova-compute[75469]: DEBUG nova.compute.manager [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 2048496d-3733-4ca5-b27a-f6be129b7c0b] Deleting volume: 151f7a9f-3545-4445-83a9-a25acb53351e {{(pid=75469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:55 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:56 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Deleted allocations for instance 2048496d-3733-4ca5-b27a-f6be129b7c0b
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0c037af2-296b-4c5a-b7e1-7caff39bea6e tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "2048496d-3733-4ca5-b27a-f6be129b7c0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.442s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:09:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:09:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:09:57 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8056MB free_disk=24.794906616210938GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 929364ea-9d56-41ff-a393-8abd7df60eec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 87874095-a320-4445-8dd3-b7b259764dfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 9a0c1e54-59d5-4890-9c6c-3bc34928bb65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a8ffecbb-5de1-4425-adc5-77fab650b8bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance eb5e944a-cdd5-49e7-b17e-67ae91ba8413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:09:57 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:09:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:09:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:09:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Updating instance_info_cache with network_info: [{"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:10:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:10:01 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:10:02 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:10:02 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:10:02 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:10:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:10:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-9ce767c2-e381-4ea1-8aa7-e8f30a40d3e3 req-2f0cb714-1a18-4d56-8f44-9ab1e58778a2 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received event network-changed-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:10:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-9ce767c2-e381-4ea1-8aa7-e8f30a40d3e3 req-2f0cb714-1a18-4d56-8f44-9ab1e58778a2 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Refreshing instance network info cache due to event network-changed-c79b50cb-44ce-424a-8370-a840da4b45bd. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:10:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9ce767c2-e381-4ea1-8aa7-e8f30a40d3e3 req-2f0cb714-1a18-4d56-8f44-9ab1e58778a2 service nova] Acquiring lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:10:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9ce767c2-e381-4ea1-8aa7-e8f30a40d3e3 req-2f0cb714-1a18-4d56-8f44-9ab1e58778a2 service nova] Acquired lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:10:18 user nova-compute[75469]: DEBUG nova.network.neutron [req-9ce767c2-e381-4ea1-8aa7-e8f30a40d3e3 req-2f0cb714-1a18-4d56-8f44-9ab1e58778a2 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Refreshing network info cache for port c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG nova.objects.instance [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lazy-loading 'flavor' on Instance uuid eb5e944a-cdd5-49e7-b17e-67ae91ba8413 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-9ce767c2-e381-4ea1-8aa7-e8f30a40d3e3 req-2f0cb714-1a18-4d56-8f44-9ab1e58778a2 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Updated VIF entry in instance network info cache for port c79b50cb-44ce-424a-8370-a840da4b45bd. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-9ce767c2-e381-4ea1-8aa7-e8f30a40d3e3 req-2f0cb714-1a18-4d56-8f44-9ab1e58778a2 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Updating instance_info_cache with network_info: [{"id": "c79b50cb-44ce-424a-8370-a840da4b45bd", "address": "fa:16:3e:fd:10:48", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b50cb-44", "ovs_interfaceid": "c79b50cb-44ce-424a-8370-a840da4b45bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9ce767c2-e381-4ea1-8aa7-e8f30a40d3e3 req-2f0cb714-1a18-4d56-8f44-9ab1e58778a2 service nova] Releasing lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:19 user nova-compute[75469]: INFO nova.compute.manager [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Attaching volume e385f405-cb38-4316-81d1-2462b44d49e3 to /dev/vdb
Nov 14 05:10:19 user nova-compute[75469]: DEBUG os_brick.utils [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[42320c59-62f4-4430-bc2c-0f425a68c821]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c162e515-5737-4318-8043-10030b3df50d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[894dc6c1-8f6d-4ed5-add2-617b8b16c5c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7afcae-6b2c-4398-91eb-e6d617d2a9cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:10:19 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:10:19 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4775ed97-fd8d-4b0b-92ca-cab51f409c80]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG os_brick.utils [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:10:19 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Updating existing volume attachment record: 5f381dc4-5c4b-4c98-86a7-24786671a3d9 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:10:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlQBiaLJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:10:24 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:10:24 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:10:24 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[494b1a61-2993-4df6-9b06-e583e57bb551]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:10:24 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[153785a0-b873-4ac5-8e3a-6823139e4516]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3] added
Nov 14 05:10:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c58138-3496-4952-8fc3-69223be0bd5b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f9511-ef46-4384-9a36-63ac25138de3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlQBiaLJ {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlQBiaLJ" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b5d432-43fa-4520-9b13-0c00fac9a8cf]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qlQBiaLJ'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d423c46-53ec-4efb-b29b-a15862415852]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[55122327-7c8c-47e6-981e-0b445e6d186c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:10:24 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:10:24 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:10:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:10:24 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:10:24 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:10:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[473b65f7-577d-43de-95df-c47bbd9512c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3, portal: 172.16.0.220,3260]
Nov 14 05:10:24 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3, portal: 172.16.0.220,3260] successful.
Nov 14 05:10:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a31e1-10ff-40e6-8fa7-78d9fdece4b6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4662e74-3e1a-4ead-a9f3-e357ea3173a3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:10:24 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:10:24 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:10:24 user nova-compute[75469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)
Nov 14 05:10:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:10:24 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:10:24 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:10:24 user nova-compute[75469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)
Nov 14 05:10:24 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45e8b44-59b1-4914-82ce-1dbad8109e3f]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:10:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlQBiaLJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:10:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:10:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23036363035376264', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:10:25 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036363035376264', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:10:25 user nova-compute[75469]: DEBUG nova.objects.instance [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lazy-loading 'flavor' on Instance uuid eb5e944a-cdd5-49e7-b17e-67ae91ba8413 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:10:25 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:10:25 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:10:25 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:10:25 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:10:25 user nova-compute[75469]:   <serial>e385f405-cb38-4316-81d1-2462b44d49e3</serial>
Nov 14 05:10:25 user nova-compute[75469]: </disk>
Nov 14 05:10:25 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:10:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:10:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:10:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] No VIF found with MAC fa:16:3e:fd:10:48, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:10:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-be686139-423d-41b0-96f3-0878ecb38af4 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.542s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:27 user nova-compute[75469]: INFO nova.compute.manager [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Detaching volume e385f405-cb38-4316-81d1-2462b44d49e3
Nov 14 05:10:27 user nova-compute[75469]: INFO nova.virt.block_device [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Attempting to driver detach volume e385f405-cb38-4316-81d1-2462b44d49e3 from mountpoint /dev/vdb
Nov 14 05:10:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Attempting to detach device vdb from instance eb5e944a-cdd5-49e7-b17e-67ae91ba8413 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:10:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:10:27 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:10:27 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:10:27 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:10:27 user nova-compute[75469]:   <serial>e385f405-cb38-4316-81d1-2462b44d49e3</serial>
Nov 14 05:10:27 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:10:27 user nova-compute[75469]: </disk>
Nov 14 05:10:27 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:10:27 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Successfully detached device vdb from instance eb5e944a-cdd5-49e7-b17e-67ae91ba8413 from the persistent domain config.
Nov 14 05:10:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eb5e944a-cdd5-49e7-b17e-67ae91ba8413 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:10:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:10:27 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:10:27 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:10:27 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:10:27 user nova-compute[75469]:   <serial>e385f405-cb38-4316-81d1-2462b44d49e3</serial>
Nov 14 05:10:27 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:10:27 user nova-compute[75469]: </disk>
Nov 14 05:10:27 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:10:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eb5e944a-cdd5-49e7-b17e-67ae91ba8413 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:10:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "929364ea-9d56-41ff-a393-8abd7df60eec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:34 user nova-compute[75469]: INFO nova.compute.manager [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Terminating instance
Nov 14 05:10:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-05550497-9ee7-45f6-84c3-9fb6366e63e1 req-ab23ca95-bd05-4261-8100-11b49e35dd4e service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-unplugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-05550497-9ee7-45f6-84c3-9fb6366e63e1 req-ab23ca95-bd05-4261-8100-11b49e35dd4e service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-05550497-9ee7-45f6-84c3-9fb6366e63e1 req-ab23ca95-bd05-4261-8100-11b49e35dd4e service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-05550497-9ee7-45f6-84c3-9fb6366e63e1 req-ab23ca95-bd05-4261-8100-11b49e35dd4e service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-05550497-9ee7-45f6-84c3-9fb6366e63e1 req-ab23ca95-bd05-4261-8100-11b49e35dd4e service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-unplugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-05550497-9ee7-45f6-84c3-9fb6366e63e1 req-ab23ca95-bd05-4261-8100-11b49e35dd4e service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-unplugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:10:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:35 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Instance destroyed successfully.
Nov 14 05:10:35 user nova-compute[75469]: DEBUG nova.objects.instance [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'resources' on Instance uuid 929364ea-9d56-41ff-a393-8abd7df60eec {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2102515421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2102515421',id=13,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:56:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-lwtjrbx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:58:34Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=929364ea-9d56-41ff-a393-8abd7df60eec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "44003f19-d7b1-4227-bbef-774fb01f1431", "address": "fa:16:3e:c3:04:a0", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44003f19-d7", "ovs_interfaceid": "44003f19-d7b1-4227-bbef-774fb01f1431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:04:a0,bridge_name='br-int',has_traffic_filtering=True,id=44003f19-d7b1-4227-bbef-774fb01f1431,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44003f19-d7') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_vif [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:04:a0,bridge_name='br-int',has_traffic_filtering=True,id=44003f19-d7b1-4227-bbef-774fb01f1431,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44003f19-d7') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44003f19-d7, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f364a328-c8c8-41c4-beaa-88a68ba00350) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:10:35 user nova-compute[75469]: INFO os_vif [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:04:a0,bridge_name='br-int',has_traffic_filtering=True,id=44003f19-d7b1-4227-bbef-774fb01f1431,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44003f19-d7')
Nov 14 05:10:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMLfgOGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:10:35 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[072960f1-619d-4cc4-baaf-627fdfc135d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:10:35 user nova-compute[75469]: No targets found.
Nov 14 05:10:35 user nova-compute[75469]: iSNS:
Nov 14 05:10:35 user nova-compute[75469]: No targets found.
Nov 14 05:10:35 user nova-compute[75469]: STATIC:
Nov 14 05:10:35 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3
Nov 14 05:10:35 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:10:35 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:10:35 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970
Nov 14 05:10:35 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:10:35 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:10:35 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a
Nov 14 05:10:35 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:10:35 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:10:35 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2
Nov 14 05:10:35 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:10:35 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:10:35 user nova-compute[75469]: FIRMWARE:
Nov 14 05:10:35 user nova-compute[75469]: No targets found.
Nov 14 05:10:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:10:35 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:10:35 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ef7043-f55c-4baa-baa6-e1a5e7f28b01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcbd6cd-fc7b-487c-905b-e55bac429480]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:10:35 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:10:35 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:10:35 user nova-compute[75469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)
Nov 14 05:10:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 (non-flash)
Nov 14 05:10:35 user nova-compute[75469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:10:35 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:10:35 user nova-compute[75469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)
Nov 14 05:10:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708eeaf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970'): ({'sdc'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Removing single pathed devices sdc {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee614757-4149-45b4-8176-13e824f68732]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d21626-0ecf-4a50-83cd-9b8aacfdd054]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Flushing IO for device /dev/sdc {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f2e451-c9c2-4362-b66e-f71d47dc0569]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2d7594-eb27-4f8d-9ac9-b03b92e1d7d8]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] SCSI volumes sdc have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eba7e0f-b57b-4b50-b4f4-fb4e8b57d30c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f141e3ed-98f0-48dc-922f-bbb948ac8778]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970, portal: 172.16.0.220,3260]
Nov 14 05:10:35 user nova-compute[75469]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970, portal: 172.16.0.220,3260] successful.
Nov 14 05:10:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e607621-505d-441b-869a-10a26d80e970 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f518be44-68a4-4481-a292-cabde62ce643]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] <== disconnect_volume: return (308ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:10:35 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Deleting instance files /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec_del
Nov 14 05:10:35 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Deletion of /opt/stack/data/nova/instances/929364ea-9d56-41ff-a393-8abd7df60eec_del complete
Nov 14 05:10:35 user nova-compute[75469]: INFO nova.compute.manager [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 14 05:10:35 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:10:35 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:10:36 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:10:36 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Took 0.43 seconds to deallocate network for instance.
Nov 14 05:10:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-6104a506-6dd6-4e78-8bc5-2717f0129f83 req-a9b232c4-d516-41fd-b722-35ae891a006f service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-deleted-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:10:36 user nova-compute[75469]: INFO nova.compute.manager [req-6104a506-6dd6-4e78-8bc5-2717f0129f83 req-a9b232c4-d516-41fd-b722-35ae891a006f service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Neutron deleted interface 44003f19-d7b1-4227-bbef-774fb01f1431; detaching it from the instance and deleting it from the info cache
Nov 14 05:10:36 user nova-compute[75469]: DEBUG nova.network.neutron [req-6104a506-6dd6-4e78-8bc5-2717f0129f83 req-a9b232c4-d516-41fd-b722-35ae891a006f service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:10:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-6104a506-6dd6-4e78-8bc5-2717f0129f83 req-a9b232c4-d516-41fd-b722-35ae891a006f service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Detach interface failed, port_id=44003f19-d7b1-4227-bbef-774fb01f1431, reason: Instance 929364ea-9d56-41ff-a393-8abd7df60eec could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:10:36 user nova-compute[75469]: INFO nova.compute.manager [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 05:10:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-310e952a-6e1d-4916-aaf8-da7a2d51d1a1 req-828a8c70-107f-466d-bb6f-6f3e19a53d5d service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:10:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-310e952a-6e1d-4916-aaf8-da7a2d51d1a1 req-828a8c70-107f-466d-bb6f-6f3e19a53d5d service nova] Acquiring lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-310e952a-6e1d-4916-aaf8-da7a2d51d1a1 req-828a8c70-107f-466d-bb6f-6f3e19a53d5d service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-310e952a-6e1d-4916-aaf8-da7a2d51d1a1 req-828a8c70-107f-466d-bb6f-6f3e19a53d5d service nova] Lock "929364ea-9d56-41ff-a393-8abd7df60eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:37 user nova-compute[75469]: DEBUG nova.compute.manager [req-310e952a-6e1d-4916-aaf8-da7a2d51d1a1 req-828a8c70-107f-466d-bb6f-6f3e19a53d5d service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] No waiting events found dispatching network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:10:37 user nova-compute[75469]: WARNING nova.compute.manager [req-310e952a-6e1d-4916-aaf8-da7a2d51d1a1 req-828a8c70-107f-466d-bb6f-6f3e19a53d5d service nova] [instance: 929364ea-9d56-41ff-a393-8abd7df60eec] Received unexpected event network-vif-plugged-44003f19-d7b1-4227-bbef-774fb01f1431 for instance with vm_state deleted and task_state None.
Nov 14 05:10:37 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:10:37 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:10:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:37 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Deleted allocations for instance 929364ea-9d56-41ff-a393-8abd7df60eec
Nov 14 05:10:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-772cb681-626f-46e7-98f3-64afdfea93a7 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "929364ea-9d56-41ff-a393-8abd7df60eec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.550s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:44 user nova-compute[75469]: INFO nova.compute.manager [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Terminating instance
Nov 14 05:10:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-1cabfa2f-2949-41b4-88d4-8c20f296fe8d req-b9706d51-61a0-42ed-843b-034476b88175 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Received event network-vif-unplugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1cabfa2f-2949-41b4-88d4-8c20f296fe8d req-b9706d51-61a0-42ed-843b-034476b88175 service nova] Acquiring lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1cabfa2f-2949-41b4-88d4-8c20f296fe8d req-b9706d51-61a0-42ed-843b-034476b88175 service nova] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1cabfa2f-2949-41b4-88d4-8c20f296fe8d req-b9706d51-61a0-42ed-843b-034476b88175 service nova] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-1cabfa2f-2949-41b4-88d4-8c20f296fe8d req-b9706d51-61a0-42ed-843b-034476b88175 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] No waiting events found dispatching network-vif-unplugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:10:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-1cabfa2f-2949-41b4-88d4-8c20f296fe8d req-b9706d51-61a0-42ed-843b-034476b88175 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Received event network-vif-unplugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:45 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Instance destroyed successfully.
Nov 14 05:10:45 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'resources' on Instance uuid 9a0c1e54-59d5-4890-9c6c-3bc34928bb65 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-112432102',display_name='tempest-TestVolumeBootPattern-volume-backed-server-112432102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-112432102',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsOA22kp3VaILaqFcHCVLm/S/NGmhpZLIwmk447Hs5IPUmL90u38jvH9MxCNf1cbYUHzOLezhyIc/uIwHghJkR7v4keNMW+QRRlBCFuvke4SBrY198sz2IudzNTdk0D+Q==',key_name='tempest-keypair-770505458',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-xwabq7z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=9a0c1e54-59d5-4890-9c6c-3bc34928bb65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "address": "fa:16:3e:c4:7a:7d", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213df0cd-0a", "ovs_interfaceid": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "address": "fa:16:3e:c4:7a:7d", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213df0cd-0a", "ovs_interfaceid": "213df0cd-0a8b-4c7d-a71c-4210adbadf4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7a:7d,bridge_name='br-int',has_traffic_filtering=True,id=213df0cd-0a8b-4c7d-a71c-4210adbadf4d,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213df0cd-0a') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_vif [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7a:7d,bridge_name='br-int',has_traffic_filtering=True,id=213df0cd-0a8b-4c7d-a71c-4210adbadf4d,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213df0cd-0a') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap213df0cd-0a, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89e7ecaf-004c-4d1b-bf06-4d4c61eca0f7) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:10:45 user nova-compute[75469]: INFO os_vif [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7a:7d,bridge_name='br-int',has_traffic_filtering=True,id=213df0cd-0a8b-4c7d-a71c-4210adbadf4d,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap213df0cd-0a')
Nov 14 05:10:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoiGRWwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:10:45 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6087df43-1f22-43a8-a6f1-b04610e05861]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:10:45 user nova-compute[75469]: No targets found.
Nov 14 05:10:45 user nova-compute[75469]: iSNS:
Nov 14 05:10:45 user nova-compute[75469]: No targets found.
Nov 14 05:10:45 user nova-compute[75469]: STATIC:
Nov 14 05:10:45 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3
Nov 14 05:10:45 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:10:45 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:10:45 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a
Nov 14 05:10:45 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:10:45 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:10:45 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2
Nov 14 05:10:45 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:10:45 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:10:45 user nova-compute[75469]: FIRMWARE:
Nov 14 05:10:45 user nova-compute[75469]: No targets found.
Nov 14 05:10:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:10:45 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:10:45 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7b5916-856e-4c49-ac10-d2ce126c3a98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb68823-ead8-455f-b356-79d7a367dea0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:10:45 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:10:45 user nova-compute[75469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)
Nov 14 05:10:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a (non-flash)
Nov 14 05:10:45 user nova-compute[75469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:10:45 user nova-compute[75469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)
Nov 14 05:10:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f6f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a'): ({'sdd'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Removing single pathed devices sdd {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec8b5cc-0c83-42c9-bb8b-af7821e72af3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d774ded1-18e4-4208-acdf-341c4336d7b7]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flushing IO for device /dev/sdd {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2637282-c3af-42ff-a11a-7f1358e3589d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fa8259-c008-4020-9963-0bc59359abc8]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23936383861366438', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c27dc8e3', '/dev/disk/by-id/scsi-1SCST_BIOc27dc8e3-9688a6d81b70062e') {{(pid=85531) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b96e551-304d-4b04-818b-ec8446cc4ec9]: (4, None) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[441a25a0-85ce-4560-8d0c-7987d280c7f9]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5c6dd2-c95e-4903-be5c-eab08a3265e0]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a, portal: 172.16.0.220,3260]
Nov 14 05:10:45 user nova-compute[75469]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a, portal: 172.16.0.220,3260] successful.
Nov 14 05:10:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[083bbb6d-f1c3-43d5-8411-50d4269f23ce]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== disconnect_volume: return (314ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:10:45 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Deleting instance files /opt/stack/data/nova/instances/9a0c1e54-59d5-4890-9c6c-3bc34928bb65_del
Nov 14 05:10:45 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Deletion of /opt/stack/data/nova/instances/9a0c1e54-59d5-4890-9c6c-3bc34928bb65_del complete
Nov 14 05:10:45 user nova-compute[75469]: INFO nova.compute.manager [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 14 05:10:45 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:10:45 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:10:46 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:10:46 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Took 0.61 seconds to deallocate network for instance.
Nov 14 05:10:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-2b47f1a5-ad96-4841-a016-fecbe4bf27ee req-1c0fee93-a71e-47b4-8b25-8729d6f1e10c service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Received event network-vif-deleted-213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:10:46 user nova-compute[75469]: INFO nova.compute.manager [req-2b47f1a5-ad96-4841-a016-fecbe4bf27ee req-1c0fee93-a71e-47b4-8b25-8729d6f1e10c service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Neutron deleted interface 213df0cd-0a8b-4c7d-a71c-4210adbadf4d; detaching it from the instance and deleting it from the info cache
Nov 14 05:10:46 user nova-compute[75469]: DEBUG nova.network.neutron [req-2b47f1a5-ad96-4841-a016-fecbe4bf27ee req-1c0fee93-a71e-47b4-8b25-8729d6f1e10c service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:10:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-2b47f1a5-ad96-4841-a016-fecbe4bf27ee req-1c0fee93-a71e-47b4-8b25-8729d6f1e10c service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Detach interface failed, port_id=213df0cd-0a8b-4c7d-a71c-4210adbadf4d, reason: Instance 9a0c1e54-59d5-4890-9c6c-3bc34928bb65 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:10:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-08994bd5-a649-4b12-8fed-4e8c05185292 req-68156d2a-9fb8-4e59-a001-dba7b04a3a24 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Received event network-vif-plugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:10:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-08994bd5-a649-4b12-8fed-4e8c05185292 req-68156d2a-9fb8-4e59-a001-dba7b04a3a24 service nova] Acquiring lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-08994bd5-a649-4b12-8fed-4e8c05185292 req-68156d2a-9fb8-4e59-a001-dba7b04a3a24 service nova] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-08994bd5-a649-4b12-8fed-4e8c05185292 req-68156d2a-9fb8-4e59-a001-dba7b04a3a24 service nova] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-08994bd5-a649-4b12-8fed-4e8c05185292 req-68156d2a-9fb8-4e59-a001-dba7b04a3a24 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] No waiting events found dispatching network-vif-plugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:10:46 user nova-compute[75469]: WARNING nova.compute.manager [req-08994bd5-a649-4b12-8fed-4e8c05185292 req-68156d2a-9fb8-4e59-a001-dba7b04a3a24 service nova] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Received unexpected event network-vif-plugged-213df0cd-0a8b-4c7d-a71c-4210adbadf4d for instance with vm_state active and task_state deleting.
Nov 14 05:10:47 user nova-compute[75469]: INFO nova.compute.manager [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Took 0.80 seconds to detach 1 volumes for instance.
Nov 14 05:10:47 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 9a0c1e54-59d5-4890-9c6c-3bc34928bb65] Deleting volume: d9a19fa4-0ebe-49bd-8aad-7a6b47f2411a {{(pid=75469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 05:10:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:47 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:10:47 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:10:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:47 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Deleted allocations for instance 9a0c1e54-59d5-4890-9c6c-3bc34928bb65
Nov 14 05:10:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3ebb514c-013b-4755-84ce-b08ae10feca5 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "9a0c1e54-59d5-4890-9c6c-3bc34928bb65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.069s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:47 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eb5e944a-cdd5-49e7-b17e-67ae91ba8413 is timed out.
Nov 14 05:10:47 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Successfully detached device vdb from instance eb5e944a-cdd5-49e7-b17e-67ae91ba8413 from the live domain config.
Nov 14 05:10:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:10:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlQBiaLJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:10:47 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:10:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:10:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:10:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[23160419-7bf7-4359-9a59-51e977df69ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:10:47 user nova-compute[75469]: No targets found.
Nov 14 05:10:47 user nova-compute[75469]: iSNS:
Nov 14 05:10:47 user nova-compute[75469]: No targets found.
Nov 14 05:10:47 user nova-compute[75469]: STATIC:
Nov 14 05:10:47 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3
Nov 14 05:10:47 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:10:47 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:10:47 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2
Nov 14 05:10:47 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:10:47 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:10:47 user nova-compute[75469]: FIRMWARE:
Nov 14 05:10:47 user nova-compute[75469]: No targets found.
Nov 14 05:10:47 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:10:48 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:10:48 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2308d15-5337-43ff-9343-00dc703d509c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc4ef78-b867-459a-af65-754cf8f443c4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:10:48 user nova-compute[75469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)
Nov 14 05:10:48 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:10:48 user nova-compute[75469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 (non-flash)
Nov 14 05:10:48 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c2793f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e77772-d979-4faa-b412-c86a569cab3b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1396c1f8-a664-41f2-a810-fa4119555e56]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[96088829-7061-4325-8962-aaef0be5b08f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1cc6c3-14c9-4a60-8a22-8c7a2214f7a7]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[425d0f8f-dd85-42a1-8b13-a83b2e9e26c7]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[49886506-a4d5-44c2-a055-09f669c45929]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3, portal: 172.16.0.220,3260]
Nov 14 05:10:48 user nova-compute[75469]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3, portal: 172.16.0.220,3260] successful.
Nov 14 05:10:48 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e385f405-cb38-4316-81d1-2462b44d49e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a505e4ee-e3d8-4cae-83f1-6ad8f036a67f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] <== disconnect_volume: return (292ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:10:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lazy-loading 'flavor' on Instance uuid eb5e944a-cdd5-49e7-b17e-67ae91ba8413 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:10:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-85363373-6078-478d-999a-be31a5046bb1 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.602s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:10:58 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:10:58 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:10:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8336MB free_disk=24.781681060791016GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 87874095-a320-4445-8dd3-b7b259764dfa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a8ffecbb-5de1-4425-adc5-77fab650b8bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance eb5e944a-cdd5-49e7-b17e-67ae91ba8413 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:10:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:10:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:10:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:10:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:10:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:10:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:10:59 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:10:59 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 80741f98-11b9-4a80-a51b-39d5ce4e44f5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:11:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:00 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updating instance_info_cache with network_info: [{"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-80741f98-11b9-4a80-a51b-39d5ce4e44f5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:11:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:11:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:11:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:11:01 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:11:01 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:11:02 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:11:03 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:11:03 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:04 user nova-compute[75469]: INFO nova.compute.manager [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Unshelving
Nov 14 05:11:04 user nova-compute[75469]: INFO nova.compute.manager [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Detaching volume fcb5090a-f0b5-4a17-bdf8-12dce9765cf2
Nov 14 05:11:04 user nova-compute[75469]: INFO nova.virt.block_device [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Attempting to driver detach volume fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 from mountpoint /dev/vdb
Nov 14 05:11:04 user nova-compute[75469]: INFO nova.virt.block_device [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Booting with volume 729b4621-6005-4246-b7bc-58b8d80f0088 at /dev/vda
Nov 14 05:11:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Attempting to detach device vdb from instance a8ffecbb-5de1-4425-adc5-77fab650b8bf from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:11:04 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:11:04 user nova-compute[75469]:   <source dev="/dev/sdh"/>
Nov 14 05:11:04 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:11:04 user nova-compute[75469]:   <serial>fcb5090a-f0b5-4a17-bdf8-12dce9765cf2</serial>
Nov 14 05:11:04 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 05:11:04 user nova-compute[75469]: </disk>
Nov 14 05:11:04 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:11:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully detached device vdb from instance a8ffecbb-5de1-4425-adc5-77fab650b8bf from the persistent domain config.
Nov 14 05:11:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8ffecbb-5de1-4425-adc5-77fab650b8bf from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:11:04 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:11:04 user nova-compute[75469]:   <source dev="/dev/sdh"/>
Nov 14 05:11:04 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:11:04 user nova-compute[75469]:   <serial>fcb5090a-f0b5-4a17-bdf8-12dce9765cf2</serial>
Nov 14 05:11:04 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 05:11:04 user nova-compute[75469]: </disk>
Nov 14 05:11:04 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG os_brick.utils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe5b54b-2870-4f5f-a4c9-db119220e01f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b586f8f8-9d51-4bf6-aac5-0386836307da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cec6b9a-e9e1-49f8-8763-82b61d59e386]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[be747f09-e1ad-404d-8438-affa573f4d2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:11:04 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:11:04 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e45021-933c-46f9-af74-00f037ce01f6]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG os_brick.utils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:11:04 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating existing volume attachment record: 79a361ae-d4f4-42b6-975a-a7ed684f51b9 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:11:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8ffecbb-5de1-4425-adc5-77fab650b8bf {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:11:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:11:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:09 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lazy-loading 'pci_requests' on Instance uuid e74a9e8f-2e86-4de9-9d39-5192cf5763c5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:11:09 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lazy-loading 'numa_topology' on Instance uuid e74a9e8f-2e86-4de9-9d39-5192cf5763c5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:11:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:11:09 user nova-compute[75469]: INFO nova.compute.claims [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Claim successful on node user
Nov 14 05:11:09 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:11:09 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:11:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:09 user nova-compute[75469]: INFO nova.network.neutron [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating port c3c21b15-f830-41d9-a5b6-242a097ac43d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquired lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-2082b5ad-a0ea-4b8f-8f4f-37585467988e req-21f21dd5-a8b0-4ceb-8db2-4154ff3aa4fb service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-changed-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-2082b5ad-a0ea-4b8f-8f4f-37585467988e req-21f21dd5-a8b0-4ceb-8db2-4154ff3aa4fb service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Refreshing instance network info cache due to event network-changed-c3c21b15-f830-41d9-a5b6-242a097ac43d. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2082b5ad-a0ea-4b8f-8f4f-37585467988e req-21f21dd5-a8b0-4ceb-8db2-4154ff3aa4fb service nova] Acquiring lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating instance_info_cache with network_info: [{"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Releasing lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:11:10 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Creating image(s)
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Ensure instance console log exists: /opt/stack/data/nova/instances/e74a9e8f-2e86-4de9-9d39-5192cf5763c5/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Start _get_guest_xml network_info=[{"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '79a361ae-d4f4-42b6-975a-a7ed684f51b9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnfNGRUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e74a9e8f-2e86-4de9-9d39-5192cf5763c5', 'attached_at': '', 'detached_at': '', 'volume_id': '729b4621-6005-4246-b7bc-58b8d80f0088', 'serial': '729b4621-6005-4246-b7bc-58b8d80f0088'}, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2082b5ad-a0ea-4b8f-8f4f-37585467988e req-21f21dd5-a8b0-4ceb-8db2-4154ff3aa4fb service nova] Acquired lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.network.neutron [req-2082b5ad-a0ea-4b8f-8f4f-37585467988e req-21f21dd5-a8b0-4ceb-8db2-4154ff3aa4fb service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Refreshing network info cache for port c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:11:10 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:11:10 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lazy-loading 'vcpu_model' on Instance uuid e74a9e8f-2e86-4de9-9d39-5192cf5763c5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.objects.base [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Object Instance<e74a9e8f-2e86-4de9-9d39-5192cf5763c5> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnfNGRUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:11:10 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:11:10 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:11:10 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30cfbe3-bfde-431e-b21f-b4f7b6e9333c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:11:10 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00e3ced-8fea-409d-be75-47e54ce669bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088] added
Nov 14 05:11:10 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb10c333-ed63-480a-a3b2-a09ad5eaae7d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e668c832-1bd1-4ff4-9576-a5ca2ffcb18c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnfNGRUF {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnfNGRUF" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0aeecc-74ae-430d-838c-5cb05fec4741]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qnfNGRUF'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dac079-7ed4-4e99-acb5-d7fd55decbf5]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb12a03-f8b4-48c6-9ab7-07ac60b2b5ae]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:11:10 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:11:10 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[040b5398-e1b6-473f-8787-4c70a0c4d385]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260]
Nov 14 05:11:10 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260] successful.
Nov 14 05:11:10 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[441327cf-5723-4d1b-a482-bb926665fdbe]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b50350-741b-4353-825b-252d41a95a57]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:11:10 user nova-compute[75469]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:11:10 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:11:10 user nova-compute[75469]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:11:10 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[356ff9fb-8702-478a-8478-a75f0a73a0eb]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnfNGRUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.network.neutron [req-2082b5ad-a0ea-4b8f-8f4f-37585467988e req-21f21dd5-a8b0-4ceb-8db2-4154ff3aa4fb service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updated VIF entry in instance network info cache for port c3c21b15-f830-41d9-a5b6-242a097ac43d. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG nova.network.neutron [req-2082b5ad-a0ea-4b8f-8f4f-37585467988e req-21f21dd5-a8b0-4ceb-8db2-4154ff3aa4fb service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating instance_info_cache with network_info: [{"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2082b5ad-a0ea-4b8f-8f4f-37585467988e req-21f21dd5-a8b0-4ceb-8db2-4154ff3aa4fb service nova] Releasing lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26339373133643531', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339373133643531', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T05:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116243024',display_name='tempest-TestShelveInstance-server-2116243024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116243024',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-848916377',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e916ef90975b40bdb9a887d02e4770dd',ramdisk_id='',reservation_id='r-qjebm1o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1973652568',owner_user_name='tempest-TestShelveInstance-1973652568-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:11:05Z,user_data=None,user_id='6212f1c3188246c6b94e3ad485d6174f',uuid=e74a9e8f-2e86-4de9-9d39-5192cf5763c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converting VIF {"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lazy-loading 'pci_devices' on Instance uuid e74a9e8f-2e86-4de9-9d39-5192cf5763c5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.objects.base [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Object Instance<e74a9e8f-2e86-4de9-9d39-5192cf5763c5> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:11:11 user nova-compute[75469]:   <uuid>e74a9e8f-2e86-4de9-9d39-5192cf5763c5</uuid>
Nov 14 05:11:11 user nova-compute[75469]:   <name>instance-00000026</name>
Nov 14 05:11:11 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:11:11 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:11:11 user nova-compute[75469]:   <metadata>
Nov 14 05:11:11 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:11:11 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:11:11 user nova-compute[75469]:       <nova:name>tempest-TestShelveInstance-server-2116243024</nova:name>
Nov 14 05:11:11 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:11:10</nova:creationTime>
Nov 14 05:11:11 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:11:11 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:11:11 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:11:11 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:11:11 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:11:11 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:11:11 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:11:11 user nova-compute[75469]:       <nova:owner>
Nov 14 05:11:11 user nova-compute[75469]:         <nova:user uuid="6212f1c3188246c6b94e3ad485d6174f">tempest-TestShelveInstance-1973652568-project-member</nova:user>
Nov 14 05:11:11 user nova-compute[75469]:         <nova:project uuid="e916ef90975b40bdb9a887d02e4770dd">tempest-TestShelveInstance-1973652568</nova:project>
Nov 14 05:11:11 user nova-compute[75469]:       </nova:owner>
Nov 14 05:11:11 user nova-compute[75469]:       <nova:ports>
Nov 14 05:11:11 user nova-compute[75469]:         <nova:port uuid="c3c21b15-f830-41d9-a5b6-242a097ac43d">
Nov 14 05:11:11 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 05:11:11 user nova-compute[75469]:         </nova:port>
Nov 14 05:11:11 user nova-compute[75469]:       </nova:ports>
Nov 14 05:11:11 user nova-compute[75469]:     </nova:instance>
Nov 14 05:11:11 user nova-compute[75469]:   </metadata>
Nov 14 05:11:11 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:11:11 user nova-compute[75469]:     <system>
Nov 14 05:11:11 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:11:11 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:11:11 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:11:11 user nova-compute[75469]:       <entry name="serial">e74a9e8f-2e86-4de9-9d39-5192cf5763c5</entry>
Nov 14 05:11:11 user nova-compute[75469]:       <entry name="uuid">e74a9e8f-2e86-4de9-9d39-5192cf5763c5</entry>
Nov 14 05:11:11 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:11:11 user nova-compute[75469]:     </system>
Nov 14 05:11:11 user nova-compute[75469]:   </sysinfo>
Nov 14 05:11:11 user nova-compute[75469]:   <os>
Nov 14 05:11:11 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:11:11 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:11:11 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:11:11 user nova-compute[75469]:   </os>
Nov 14 05:11:11 user nova-compute[75469]:   <features>
Nov 14 05:11:11 user nova-compute[75469]:     <acpi/>
Nov 14 05:11:11 user nova-compute[75469]:     <apic/>
Nov 14 05:11:11 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:11:11 user nova-compute[75469]:   </features>
Nov 14 05:11:11 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:11:11 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:11:11 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:11:11 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:11:11 user nova-compute[75469]:   </clock>
Nov 14 05:11:11 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:11:11 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:11:11 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:11:11 user nova-compute[75469]:   </cpu>
Nov 14 05:11:11 user nova-compute[75469]:   <devices>
Nov 14 05:11:11 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:11:11 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:11:11 user nova-compute[75469]:       <source dev="/dev/sdb"/>
Nov 14 05:11:11 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:11:11 user nova-compute[75469]:       <serial>729b4621-6005-4246-b7bc-58b8d80f0088</serial>
Nov 14 05:11:11 user nova-compute[75469]:     </disk>
Nov 14 05:11:11 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:11:11 user nova-compute[75469]:       <mac address="fa:16:3e:4b:d4:04"/>
Nov 14 05:11:11 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:11:11 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:11:11 user nova-compute[75469]:       <target dev="tapc3c21b15-f8"/>
Nov 14 05:11:11 user nova-compute[75469]:     </interface>
Nov 14 05:11:11 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:11:11 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/e74a9e8f-2e86-4de9-9d39-5192cf5763c5/console.log" append="off"/>
Nov 14 05:11:11 user nova-compute[75469]:     </serial>
Nov 14 05:11:11 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:11:11 user nova-compute[75469]:     <video>
Nov 14 05:11:11 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:11:11 user nova-compute[75469]:     </video>
Nov 14 05:11:11 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:11:11 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:11:11 user nova-compute[75469]:     </rng>
Nov 14 05:11:11 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:11:11 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:11:11 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:11:11 user nova-compute[75469]:     </memballoon>
Nov 14 05:11:11 user nova-compute[75469]:   </devices>
Nov 14 05:11:11 user nova-compute[75469]: </domain>
Nov 14 05:11:11 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T05:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116243024',display_name='tempest-TestShelveInstance-server-2116243024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116243024',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-848916377',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e916ef90975b40bdb9a887d02e4770dd',ramdisk_id='',reservation_id='r-qjebm1o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1973652568',owner_user_name='tempest-TestShelveInstance-1973652568-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:11:05Z,user_data=None,user_id='6212f1c3188246c6b94e3ad485d6174f',uuid=e74a9e8f-2e86-4de9-9d39-5192cf5763c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converting VIF {"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG os_vif [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a192486d-9eab-5987-9a2f-11528c62c773', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3c21b15-f8, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3c21b15-f8, col_values=(('qos', UUID('7dc59dd0-2e8e-4353-84de-0ef1113a2c58')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3c21b15-f8, col_values=(('external_ids', {'iface-id': 'c3c21b15-f830-41d9-a5b6-242a097ac43d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:d4:04', 'vm-uuid': 'e74a9e8f-2e86-4de9-9d39-5192cf5763c5'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:11 user nova-compute[75469]: INFO os_vif [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8')
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:11:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] No VIF found with MAC fa:16:3e:4b:d4:04, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:11:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-93c0f915-5794-4c6c-b342-6ed7858e3873 req-6a45b788-74d5-43b1-9a4f-c4eee77e4f22 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-93c0f915-5794-4c6c-b342-6ed7858e3873 req-6a45b788-74d5-43b1-9a4f-c4eee77e4f22 service nova] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-93c0f915-5794-4c6c-b342-6ed7858e3873 req-6a45b788-74d5-43b1-9a4f-c4eee77e4f22 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-93c0f915-5794-4c6c-b342-6ed7858e3873 req-6a45b788-74d5-43b1-9a4f-c4eee77e4f22 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-93c0f915-5794-4c6c-b342-6ed7858e3873 req-6a45b788-74d5-43b1-9a4f-c4eee77e4f22 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] No waiting events found dispatching network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:13 user nova-compute[75469]: WARNING nova.compute.manager [req-93c0f915-5794-4c6c-b342-6ed7858e3873 req-6a45b788-74d5-43b1-9a4f-c4eee77e4f22 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received unexpected event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 05:11:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-d1df1cd4-3eec-4678-8150-844f0d57b9e8 req-3580f308-160c-4870-b0e2-dd268c2db6a3 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1df1cd4-3eec-4678-8150-844f0d57b9e8 req-3580f308-160c-4870-b0e2-dd268c2db6a3 service nova] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1df1cd4-3eec-4678-8150-844f0d57b9e8 req-3580f308-160c-4870-b0e2-dd268c2db6a3 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d1df1cd4-3eec-4678-8150-844f0d57b9e8 req-3580f308-160c-4870-b0e2-dd268c2db6a3 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-d1df1cd4-3eec-4678-8150-844f0d57b9e8 req-3580f308-160c-4870-b0e2-dd268c2db6a3 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] No waiting events found dispatching network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:15 user nova-compute[75469]: WARNING nova.compute.manager [req-d1df1cd4-3eec-4678-8150-844f0d57b9e8 req-3580f308-160c-4870-b0e2-dd268c2db6a3 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received unexpected event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 05:11:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:11:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:11:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Instance spawned successfully.
Nov 14 05:11:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:11:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e2155544-4dfd-4344-8118-55b061f7ebeb tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.959s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-4bf244bc-66a9-44b8-a7ac-2e277edb1646 req-60018273-fb5b-4d05-994f-61b9a3148f57 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received event network-changed-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-4bf244bc-66a9-44b8-a7ac-2e277edb1646 req-60018273-fb5b-4d05-994f-61b9a3148f57 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Refreshing instance network info cache due to event network-changed-c79b50cb-44ce-424a-8370-a840da4b45bd. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4bf244bc-66a9-44b8-a7ac-2e277edb1646 req-60018273-fb5b-4d05-994f-61b9a3148f57 service nova] Acquiring lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4bf244bc-66a9-44b8-a7ac-2e277edb1646 req-60018273-fb5b-4d05-994f-61b9a3148f57 service nova] Acquired lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG nova.network.neutron [req-4bf244bc-66a9-44b8-a7ac-2e277edb1646 req-60018273-fb5b-4d05-994f-61b9a3148f57 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Refreshing network info cache for port c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:18 user nova-compute[75469]: INFO nova.compute.manager [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Terminating instance
Nov 14 05:11:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-4bf244bc-66a9-44b8-a7ac-2e277edb1646 req-60018273-fb5b-4d05-994f-61b9a3148f57 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Updated VIF entry in instance network info cache for port c79b50cb-44ce-424a-8370-a840da4b45bd. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-4bf244bc-66a9-44b8-a7ac-2e277edb1646 req-60018273-fb5b-4d05-994f-61b9a3148f57 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Updating instance_info_cache with network_info: [{"id": "c79b50cb-44ce-424a-8370-a840da4b45bd", "address": "fa:16:3e:fd:10:48", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b50cb-44", "ovs_interfaceid": "c79b50cb-44ce-424a-8370-a840da4b45bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4bf244bc-66a9-44b8-a7ac-2e277edb1646 req-60018273-fb5b-4d05-994f-61b9a3148f57 service nova] Releasing lock "refresh_cache-eb5e944a-cdd5-49e7-b17e-67ae91ba8413" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:11:19 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Instance destroyed successfully.
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.objects.instance [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lazy-loading 'resources' on Instance uuid eb5e944a-cdd5-49e7-b17e-67ae91ba8413 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1475331482',display_name='tempest-TestStampPattern-server-1475331482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1475331482',id=40,image_ref='f891e1de-0f87-4c58-b6d7-7aa478799c83',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIbprXKukdzTIGKQy5CdrYJsNjT3KMcr1m2DCPZxsN4W045qdvgMW40zZ6YaNfSahpFUhbzXXXrWBXhMt7BGmhkttHYyfVM1bsmzIIYbrZC/EfH3ShlUu1reGi0vZx7ZQ==',key_name='tempest-TestStampPattern-1132364811',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:08:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a227a14762d241479644c6bfdf340bee',ramdisk_id='',reservation_id='r-ahwq8au4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='87874095-a320-4445-8dd3-b7b259764dfa',image_min_disk='1',image_min_ram='0',image_owner_id='a227a14762d241479644c6bfdf340bee',image_owner_project_name='tempest-TestStampPattern-1299350604',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1299350604-project-member',image_user_id='aee00a8861b64c90aef13e13ca17b8d0',owner_project_name='tempest-TestStampPattern-1299350604',owner_user_name='tempest-TestStampPattern-1299350604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:08:34Z,user_data=None,user_id='aee00a8861b64c90aef13e13ca17b8d0',uuid=eb5e944a-cdd5-49e7-b17e-67ae91ba8413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c79b50cb-44ce-424a-8370-a840da4b45bd", "address": "fa:16:3e:fd:10:48", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b50cb-44", "ovs_interfaceid": "c79b50cb-44ce-424a-8370-a840da4b45bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converting VIF {"id": "c79b50cb-44ce-424a-8370-a840da4b45bd", "address": "fa:16:3e:fd:10:48", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79b50cb-44", "ovs_interfaceid": "c79b50cb-44ce-424a-8370-a840da4b45bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:10:48,bridge_name='br-int',has_traffic_filtering=True,id=c79b50cb-44ce-424a-8370-a840da4b45bd,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b50cb-44') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG os_vif [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:10:48,bridge_name='br-int',has_traffic_filtering=True,id=c79b50cb-44ce-424a-8370-a840da4b45bd,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b50cb-44') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc79b50cb-44, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5978b891-5fb0-421d-b1d7-d9149002401a) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-70ca97fa-3784-46a9-bb46-8ba5c2a29964 req-a2a4ed37-ea9f-4845-88bc-c993f994e49d service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received event network-vif-unplugged-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-70ca97fa-3784-46a9-bb46-8ba5c2a29964 req-a2a4ed37-ea9f-4845-88bc-c993f994e49d service nova] Acquiring lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-70ca97fa-3784-46a9-bb46-8ba5c2a29964 req-a2a4ed37-ea9f-4845-88bc-c993f994e49d service nova] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-70ca97fa-3784-46a9-bb46-8ba5c2a29964 req-a2a4ed37-ea9f-4845-88bc-c993f994e49d service nova] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-70ca97fa-3784-46a9-bb46-8ba5c2a29964 req-a2a4ed37-ea9f-4845-88bc-c993f994e49d service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] No waiting events found dispatching network-vif-unplugged-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-70ca97fa-3784-46a9-bb46-8ba5c2a29964 req-a2a4ed37-ea9f-4845-88bc-c993f994e49d service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received event network-vif-unplugged-c79b50cb-44ce-424a-8370-a840da4b45bd for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:19 user nova-compute[75469]: INFO os_vif [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:10:48,bridge_name='br-int',has_traffic_filtering=True,id=c79b50cb-44ce-424a-8370-a840da4b45bd,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79b50cb-44')
Nov 14 05:11:19 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Deleting instance files /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413_del
Nov 14 05:11:19 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Deletion of /opt/stack/data/nova/instances/eb5e944a-cdd5-49e7-b17e-67ae91ba8413_del complete
Nov 14 05:11:19 user nova-compute[75469]: INFO nova.compute.manager [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 05:11:19 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:19 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Took 0.71 seconds to deallocate network for instance.
Nov 14 05:11:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-09a77341-3f17-41b0-a18d-6d99827d13ab req-85ed0dbc-78e5-44ec-b943-fc04efc4cced service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received event network-vif-deleted-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:20 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:11:20 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:11:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:20 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Deleted allocations for instance eb5e944a-cdd5-49e7-b17e-67ae91ba8413
Nov 14 05:11:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb28d245-d1c5-4d57-8f6d-841b99477801 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.208s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-9be3dd67-0c53-4b13-b561-b6357167d405 req-53a4e25f-a2e5-40fb-b4e1-b7c09ab61664 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received event network-vif-plugged-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9be3dd67-0c53-4b13-b561-b6357167d405 req-53a4e25f-a2e5-40fb-b4e1-b7c09ab61664 service nova] Acquiring lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9be3dd67-0c53-4b13-b561-b6357167d405 req-53a4e25f-a2e5-40fb-b4e1-b7c09ab61664 service nova] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9be3dd67-0c53-4b13-b561-b6357167d405 req-53a4e25f-a2e5-40fb-b4e1-b7c09ab61664 service nova] Lock "eb5e944a-cdd5-49e7-b17e-67ae91ba8413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-9be3dd67-0c53-4b13-b561-b6357167d405 req-53a4e25f-a2e5-40fb-b4e1-b7c09ab61664 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] No waiting events found dispatching network-vif-plugged-c79b50cb-44ce-424a-8370-a840da4b45bd {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:21 user nova-compute[75469]: WARNING nova.compute.manager [req-9be3dd67-0c53-4b13-b561-b6357167d405 req-53a4e25f-a2e5-40fb-b4e1-b7c09ab61664 service nova] [instance: eb5e944a-cdd5-49e7-b17e-67ae91ba8413] Received unexpected event network-vif-plugged-c79b50cb-44ce-424a-8370-a840da4b45bd for instance with vm_state deleted and task_state None.
Nov 14 05:11:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:25 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8ffecbb-5de1-4425-adc5-77fab650b8bf is timed out.
Nov 14 05:11:25 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully detached device vdb from instance a8ffecbb-5de1-4425-adc5-77fab650b8bf from the live domain config.
Nov 14 05:11:25 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FyVnfLjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:11:25 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[153bb14d-ec8b-435e-b5c8-fb571a7714ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:11:25 user nova-compute[75469]: No targets found.
Nov 14 05:11:25 user nova-compute[75469]: iSNS:
Nov 14 05:11:25 user nova-compute[75469]: No targets found.
Nov 14 05:11:25 user nova-compute[75469]: STATIC:
Nov 14 05:11:25 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088
Nov 14 05:11:25 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:11:25 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:11:25 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2
Nov 14 05:11:25 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:11:25 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:11:25 user nova-compute[75469]: FIRMWARE:
Nov 14 05:11:25 user nova-compute[75469]: No targets found.
Nov 14 05:11:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:11:25 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:11:25 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b79729-72fe-4b69-ac78-ea18defba8f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e08777a-c83d-462d-9179-06e15911cb47]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:11:25 user nova-compute[75469]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:11:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 (non-flash)
Nov 14 05:11:25 user nova-compute[75469]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:11:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c281120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2'): ({'sdh'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Removing single pathed devices sdh {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4698fa0-2d6b-4841-bc9e-f9abc4c72d92]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff96d6ac-79bc-49d1-adcb-c8c433c76232]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flushing IO for device /dev/sdh {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a59c75-92d5-4fe4-8e46-a1b4a3da0269]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3053fbf-d32a-4682-928b-536fe5ba78f3]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] SCSI volumes sdh have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b3efc3-1cbc-4b32-894d-3c49152c8478]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:25 user nova-compute[75469]: INFO nova.compute.manager [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Terminating instance
Nov 14 05:11:25 user nova-compute[75469]: DEBUG nova.compute.manager [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9263fe6d-8c79-4e3e-9249-957e151d079b]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260]
Nov 14 05:11:25 user nova-compute[75469]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2, portal: 172.16.0.220,3260] successful.
Nov 14 05:11:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb5090a-f0b5-4a17-bdf8-12dce9765cf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bff2785-7182-4ac1-b8a3-3a618baa90ce]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== disconnect_volume: return (325ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-75ef1373-8ba3-4745-8385-995f246b64b4 req-6fbb3c37-a6a2-4cdd-ae69-2b9fe402d4ef service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Received event network-vif-unplugged-46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-75ef1373-8ba3-4745-8385-995f246b64b4 req-6fbb3c37-a6a2-4cdd-ae69-2b9fe402d4ef service nova] Acquiring lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-75ef1373-8ba3-4745-8385-995f246b64b4 req-6fbb3c37-a6a2-4cdd-ae69-2b9fe402d4ef service nova] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-75ef1373-8ba3-4745-8385-995f246b64b4 req-6fbb3c37-a6a2-4cdd-ae69-2b9fe402d4ef service nova] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-75ef1373-8ba3-4745-8385-995f246b64b4 req-6fbb3c37-a6a2-4cdd-ae69-2b9fe402d4ef service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] No waiting events found dispatching network-vif-unplugged-46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-75ef1373-8ba3-4745-8385-995f246b64b4 req-6fbb3c37-a6a2-4cdd-ae69-2b9fe402d4ef service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Received event network-vif-unplugged-46427af9-a17a-49dd-9905-509577765b07 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:11:25 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Instance destroyed successfully.
Nov 14 05:11:25 user nova-compute[75469]: DEBUG nova.objects.instance [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lazy-loading 'resources' on Instance uuid 80741f98-11b9-4a80-a51b-39d5ce4e44f5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:11:25 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-548546716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-548546716',id=1,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:52:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e392b9dd841a4eacab6c4aff4f60e536',ramdisk_id='',reservation_id='r-llt9y47v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:53:44Z,user_data=None,user_id='3a23a8feda3e4d7581666ca3ee20aa5f',uuid=80741f98-11b9-4a80-a51b-39d5ce4e44f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converting VIF {"id": "46427af9-a17a-49dd-9905-509577765b07", "address": "fa:16:3e:23:9a:cd", "network": {"id": "1e0b31e3-2239-4a5f-9034-73911ddbc12a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528053722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e392b9dd841a4eacab6c4aff4f60e536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46427af9-a1", "ovs_interfaceid": "46427af9-a17a-49dd-9905-509577765b07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=46427af9-a17a-49dd-9905-509577765b07,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46427af9-a1') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG os_vif [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=46427af9-a17a-49dd-9905-509577765b07,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46427af9-a1') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46427af9-a1, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00c64214-cad3-4549-baf1-1bbfaed6e266) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:26 user nova-compute[75469]: INFO os_vif [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=46427af9-a17a-49dd-9905-509577765b07,network=Network(1e0b31e3-2239-4a5f-9034-73911ddbc12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46427af9-a1')
Nov 14 05:11:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Deleting instance files /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5_del
Nov 14 05:11:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Deletion of /opt/stack/data/nova/instances/80741f98-11b9-4a80-a51b-39d5ce4e44f5_del complete
Nov 14 05:11:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:26 user nova-compute[75469]: INFO nova.compute.manager [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 14 05:11:26 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG nova.objects.instance [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'flavor' on Instance uuid a8ffecbb-5de1-4425-adc5-77fab650b8bf {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-936dfba9-02e0-4759-957e-4b1b7381916a tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.829s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:26 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Took 0.48 seconds to deallocate network for instance.
Nov 14 05:11:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-4142d6ee-8a1e-435c-aa41-76bb42dcb089 req-6036dcc4-e002-4a06-9874-163fc8b99dcc service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Received event network-vif-deleted-46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:26 user nova-compute[75469]: INFO nova.compute.manager [req-4142d6ee-8a1e-435c-aa41-76bb42dcb089 req-6036dcc4-e002-4a06-9874-163fc8b99dcc service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Neutron deleted interface 46427af9-a17a-49dd-9905-509577765b07; detaching it from the instance and deleting it from the info cache
Nov 14 05:11:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-4142d6ee-8a1e-435c-aa41-76bb42dcb089 req-6036dcc4-e002-4a06-9874-163fc8b99dcc service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-4142d6ee-8a1e-435c-aa41-76bb42dcb089 req-6036dcc4-e002-4a06-9874-163fc8b99dcc service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Detach interface failed, port_id=46427af9-a17a-49dd-9905-509577765b07, reason: Instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:11:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:26 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Deleted allocations for instance 80741f98-11b9-4a80-a51b-39d5ce4e44f5
Nov 14 05:11:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e253751-9dde-43de-ac5b-d96cb42b8707 tempest-ServerBootFromVolumeStableRescueTest-1634984639 tempest-ServerBootFromVolumeStableRescueTest-1634984639-project-member] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.653s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-6c930680-0c8b-4c77-a91f-33c9731bc6f8 req-4c383482-c091-4b2a-bf64-210bf0fd44df service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Received event network-vif-plugged-46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6c930680-0c8b-4c77-a91f-33c9731bc6f8 req-4c383482-c091-4b2a-bf64-210bf0fd44df service nova] Acquiring lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6c930680-0c8b-4c77-a91f-33c9731bc6f8 req-4c383482-c091-4b2a-bf64-210bf0fd44df service nova] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6c930680-0c8b-4c77-a91f-33c9731bc6f8 req-4c383482-c091-4b2a-bf64-210bf0fd44df service nova] Lock "80741f98-11b9-4a80-a51b-39d5ce4e44f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-6c930680-0c8b-4c77-a91f-33c9731bc6f8 req-4c383482-c091-4b2a-bf64-210bf0fd44df service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] No waiting events found dispatching network-vif-plugged-46427af9-a17a-49dd-9905-509577765b07 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:27 user nova-compute[75469]: WARNING nova.compute.manager [req-6c930680-0c8b-4c77-a91f-33c9731bc6f8 req-4c383482-c091-4b2a-bf64-210bf0fd44df service nova] [instance: 80741f98-11b9-4a80-a51b-39d5ce4e44f5] Received unexpected event network-vif-plugged-46427af9-a17a-49dd-9905-509577765b07 for instance with vm_state deleted and task_state None.
Nov 14 05:11:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:31 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:11:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:31 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:11:31 user nova-compute[75469]: INFO nova.compute.claims [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Claim successful on node user
Nov 14 05:11:32 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:11:32 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:11:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG nova.policy [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7864a212cd5548f6a8b3d07a3e4a2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d0f57326454312bee742d698e94a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:11:32 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Creating image(s)
Nov 14 05:11:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "/opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "/opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "/opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "152c2dbe5f0b449a2af13a646ccb0aaae05eebdb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "152c2dbe5f0b449a2af13a646ccb0aaae05eebdb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb.part --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:32 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Successfully created port: 37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb.part --force-share --output=json" returned: 0 in 0.203s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG nova.virt.images [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] fd65ed82-e150-4a4e-a620-4b8e761d1930 was qcow2, converting to raw {{(pid=75469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb.part /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb.converted {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb.part /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb.converted" returned: 0 in 0.146s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb.converted --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "152c2dbe5f0b449a2af13a646ccb0aaae05eebdb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.026s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Successfully updated port: 37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquired lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG nova.compute.manager [req-94f73c45-8e5e-44f9-af0d-45b5d83979d0 req-7a2db9af-0e23-43a0-923e-79e84d4a28cb service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-changed-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG nova.compute.manager [req-94f73c45-8e5e-44f9-af0d-45b5d83979d0 req-7a2db9af-0e23-43a0-923e-79e84d4a28cb service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Refreshing instance network info cache due to event network-changed-37573211-71cc-4684-8d46-5ed2ee9ffae7. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-94f73c45-8e5e-44f9-af0d-45b5d83979d0 req-7a2db9af-0e23-43a0-923e-79e84d4a28cb service nova] Acquiring lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "152c2dbe5f0b449a2af13a646ccb0aaae05eebdb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "152c2dbe5f0b449a2af13a646ccb0aaae05eebdb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb,backing_fmt=raw /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:33 user nova-compute[75469]: DEBUG nova.network.neutron [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updating instance_info_cache with network_info: [{"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Releasing lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Instance network_info: |[{"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-94f73c45-8e5e-44f9-af0d-45b5d83979d0 req-7a2db9af-0e23-43a0-923e-79e84d4a28cb service nova] Acquired lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.network.neutron [req-94f73c45-8e5e-44f9-af0d-45b5d83979d0 req-7a2db9af-0e23-43a0-923e-79e84d4a28cb service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Refreshing network info cache for port 37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb,backing_fmt=raw /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk 1073741824" returned: 0 in 0.250s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "152c2dbe5f0b449a2af13a646ccb0aaae05eebdb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.438s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Cannot resize image /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Ensure instance console log exists: /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Start _get_guest_xml network_info=[{"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T05:11:29Z,direct_url=<?>,disk_format='qcow2',id=fd65ed82-e150-4a4e-a620-4b8e761d1930,min_disk=0,min_ram=0,name='tempest-scenario-img--1456567849',owner='d0d0f57326454312bee742d698e94a3b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T05:11:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'fd65ed82-e150-4a4e-a620-4b8e761d1930'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:11:34 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:11:34 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T05:11:29Z,direct_url=<?>,disk_format='qcow2',id=fd65ed82-e150-4a4e-a620-4b8e761d1930,min_disk=0,min_ram=0,name='tempest-scenario-img--1456567849',owner='d0d0f57326454312bee742d698e94a3b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T05:11:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754582521',display_name='tempest-TestMinimumBasicScenario-server-754582521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754582521',id=41,image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdn1x0SKdYYLCaB5aogNfyXlQllNVgU2V9rN6tlqiyZC6vNZwxiijQz42jIjTuGsw+EMMki730cHdn1TpeLr4rHn54ZYliYxshD7hA5TC5owk6EoWBzILFVaSibpTEvrw==',key_name='tempest-TestMinimumBasicScenario-1213478591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d0f57326454312bee742d698e94a3b',ramdisk_id='',reservation_id='r-wbj1wlwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1786662085',owner_user_name='tempest-TestMinimumBasicScenario-1786662085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:11:32Z,user_data=None,user_id='7864a212cd5548f6a8b3d07a3e4a2d58',uuid=67ad2387-630f-4066-b1eb-5c915b16232f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converting VIF {"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.objects.instance [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'pci_devices' on Instance uuid 67ad2387-630f-4066-b1eb-5c915b16232f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:11:34 user nova-compute[75469]:   <uuid>67ad2387-630f-4066-b1eb-5c915b16232f</uuid>
Nov 14 05:11:34 user nova-compute[75469]:   <name>instance-00000029</name>
Nov 14 05:11:34 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:11:34 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:11:34 user nova-compute[75469]:   <metadata>
Nov 14 05:11:34 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:11:34 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:11:34 user nova-compute[75469]:       <nova:name>tempest-TestMinimumBasicScenario-server-754582521</nova:name>
Nov 14 05:11:34 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:11:34</nova:creationTime>
Nov 14 05:11:34 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:11:34 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:11:34 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:11:34 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:11:34 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:11:34 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:11:34 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:11:34 user nova-compute[75469]:       <nova:owner>
Nov 14 05:11:34 user nova-compute[75469]:         <nova:user uuid="7864a212cd5548f6a8b3d07a3e4a2d58">tempest-TestMinimumBasicScenario-1786662085-project-member</nova:user>
Nov 14 05:11:34 user nova-compute[75469]:         <nova:project uuid="d0d0f57326454312bee742d698e94a3b">tempest-TestMinimumBasicScenario-1786662085</nova:project>
Nov 14 05:11:34 user nova-compute[75469]:       </nova:owner>
Nov 14 05:11:34 user nova-compute[75469]:       <nova:root type="image" uuid="fd65ed82-e150-4a4e-a620-4b8e761d1930"/>
Nov 14 05:11:34 user nova-compute[75469]:       <nova:ports>
Nov 14 05:11:34 user nova-compute[75469]:         <nova:port uuid="37573211-71cc-4684-8d46-5ed2ee9ffae7">
Nov 14 05:11:34 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 05:11:34 user nova-compute[75469]:         </nova:port>
Nov 14 05:11:34 user nova-compute[75469]:       </nova:ports>
Nov 14 05:11:34 user nova-compute[75469]:     </nova:instance>
Nov 14 05:11:34 user nova-compute[75469]:   </metadata>
Nov 14 05:11:34 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:11:34 user nova-compute[75469]:     <system>
Nov 14 05:11:34 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:11:34 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:11:34 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:11:34 user nova-compute[75469]:       <entry name="serial">67ad2387-630f-4066-b1eb-5c915b16232f</entry>
Nov 14 05:11:34 user nova-compute[75469]:       <entry name="uuid">67ad2387-630f-4066-b1eb-5c915b16232f</entry>
Nov 14 05:11:34 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:11:34 user nova-compute[75469]:     </system>
Nov 14 05:11:34 user nova-compute[75469]:   </sysinfo>
Nov 14 05:11:34 user nova-compute[75469]:   <os>
Nov 14 05:11:34 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:11:34 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:11:34 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:11:34 user nova-compute[75469]:   </os>
Nov 14 05:11:34 user nova-compute[75469]:   <features>
Nov 14 05:11:34 user nova-compute[75469]:     <acpi/>
Nov 14 05:11:34 user nova-compute[75469]:     <apic/>
Nov 14 05:11:34 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:11:34 user nova-compute[75469]:   </features>
Nov 14 05:11:34 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:11:34 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:11:34 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:11:34 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:11:34 user nova-compute[75469]:   </clock>
Nov 14 05:11:34 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:11:34 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:11:34 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:11:34 user nova-compute[75469]:   </cpu>
Nov 14 05:11:34 user nova-compute[75469]:   <devices>
Nov 14 05:11:34 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:11:34 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:11:34 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk"/>
Nov 14 05:11:34 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:11:34 user nova-compute[75469]:     </disk>
Nov 14 05:11:34 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:11:34 user nova-compute[75469]:       <mac address="fa:16:3e:9a:ba:f5"/>
Nov 14 05:11:34 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:11:34 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:11:34 user nova-compute[75469]:       <target dev="tap37573211-71"/>
Nov 14 05:11:34 user nova-compute[75469]:     </interface>
Nov 14 05:11:34 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:11:34 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/console.log" append="off"/>
Nov 14 05:11:34 user nova-compute[75469]:     </serial>
Nov 14 05:11:34 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:11:34 user nova-compute[75469]:     <video>
Nov 14 05:11:34 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:11:34 user nova-compute[75469]:     </video>
Nov 14 05:11:34 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:11:34 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:11:34 user nova-compute[75469]:     </rng>
Nov 14 05:11:34 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:11:34 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:11:34 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:11:34 user nova-compute[75469]:     </memballoon>
Nov 14 05:11:34 user nova-compute[75469]:   </devices>
Nov 14 05:11:34 user nova-compute[75469]: </domain>
Nov 14 05:11:34 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754582521',display_name='tempest-TestMinimumBasicScenario-server-754582521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754582521',id=41,image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdn1x0SKdYYLCaB5aogNfyXlQllNVgU2V9rN6tlqiyZC6vNZwxiijQz42jIjTuGsw+EMMki730cHdn1TpeLr4rHn54ZYliYxshD7hA5TC5owk6EoWBzILFVaSibpTEvrw==',key_name='tempest-TestMinimumBasicScenario-1213478591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d0f57326454312bee742d698e94a3b',ramdisk_id='',reservation_id='r-wbj1wlwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1786662085',owner_user_name='tempest-TestMinimumBasicScenario-1786662085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:11:32Z,user_data=None,user_id='7864a212cd5548f6a8b3d07a3e4a2d58',uuid=67ad2387-630f-4066-b1eb-5c915b16232f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converting VIF {"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG os_vif [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c0351c2-171c-54ab-b257-96108793a167', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37573211-71, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37573211-71, col_values=(('qos', UUID('4bf77beb-e2c9-41c7-b4ee-0f132512bb33')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37573211-71, col_values=(('external_ids', {'iface-id': '37573211-71cc-4684-8d46-5ed2ee9ffae7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:ba:f5', 'vm-uuid': '67ad2387-630f-4066-b1eb-5c915b16232f'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:34 user nova-compute[75469]: INFO os_vif [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71')
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] No VIF found with MAC fa:16:3e:9a:ba:f5, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.network.neutron [req-94f73c45-8e5e-44f9-af0d-45b5d83979d0 req-7a2db9af-0e23-43a0-923e-79e84d4a28cb service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updated VIF entry in instance network info cache for port 37573211-71cc-4684-8d46-5ed2ee9ffae7. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG nova.network.neutron [req-94f73c45-8e5e-44f9-af0d-45b5d83979d0 req-7a2db9af-0e23-43a0-923e-79e84d4a28cb service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updating instance_info_cache with network_info: [{"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-94f73c45-8e5e-44f9-af0d-45b5d83979d0 req-7a2db9af-0e23-43a0-923e-79e84d4a28cb service nova] Releasing lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:11:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-1b9cb3ad-4745-4d2c-bd38-a7fe3bbc164f req-9df0385e-9955-4942-a0f8-f93e79ca06ba service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1b9cb3ad-4745-4d2c-bd38-a7fe3bbc164f req-9df0385e-9955-4942-a0f8-f93e79ca06ba service nova] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1b9cb3ad-4745-4d2c-bd38-a7fe3bbc164f req-9df0385e-9955-4942-a0f8-f93e79ca06ba service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1b9cb3ad-4745-4d2c-bd38-a7fe3bbc164f req-9df0385e-9955-4942-a0f8-f93e79ca06ba service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-1b9cb3ad-4745-4d2c-bd38-a7fe3bbc164f req-9df0385e-9955-4942-a0f8-f93e79ca06ba service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] No waiting events found dispatching network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:36 user nova-compute[75469]: WARNING nova.compute.manager [req-1b9cb3ad-4745-4d2c-bd38-a7fe3bbc164f req-9df0385e-9955-4942-a0f8-f93e79ca06ba service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received unexpected event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 for instance with vm_state building and task_state spawning.
Nov 14 05:11:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:11:38 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Instance spawned successfully.
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:38 user nova-compute[75469]: INFO nova.compute.manager [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-20cdb9d8-b7d7-479c-af66-25f3c771bba9 req-aedd69a0-f119-46ee-b315-f35bad2ab1a4 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-20cdb9d8-b7d7-479c-af66-25f3c771bba9 req-aedd69a0-f119-46ee-b315-f35bad2ab1a4 service nova] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-20cdb9d8-b7d7-479c-af66-25f3c771bba9 req-aedd69a0-f119-46ee-b315-f35bad2ab1a4 service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-20cdb9d8-b7d7-479c-af66-25f3c771bba9 req-aedd69a0-f119-46ee-b315-f35bad2ab1a4 service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-20cdb9d8-b7d7-479c-af66-25f3c771bba9 req-aedd69a0-f119-46ee-b315-f35bad2ab1a4 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] No waiting events found dispatching network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:38 user nova-compute[75469]: WARNING nova.compute.manager [req-20cdb9d8-b7d7-479c-af66-25f3c771bba9 req-aedd69a0-f119-46ee-b315-f35bad2ab1a4 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received unexpected event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 for instance with vm_state building and task_state spawning.
Nov 14 05:11:38 user nova-compute[75469]: INFO nova.compute.manager [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Took 6.45 seconds to build instance.
Nov 14 05:11:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-bb5d5e44-8d21-4cdc-b14c-df1ee41e876c tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.575s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "4172a681-fc80-4941-9dff-020fa7178f5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "4172a681-fc80-4941-9dff-020fa7178f5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:40 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:11:41 user nova-compute[75469]: INFO nova.compute.claims [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Claim successful on node user
Nov 14 05:11:41 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:11:41 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:11:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG nova.policy [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0155ca3745514d6c8c0ab08a9182df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf022cc839af44ff89e4249410c4a9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:11:41 user nova-compute[75469]: INFO nova.virt.block_device [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Booting with volume abafa81b-179e-47ae-a014-5a2c909c21cf at /dev/vda
Nov 14 05:11:41 user nova-compute[75469]: DEBUG os_brick.utils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5bfc8a-926e-436f-be70-eaa2301fd334]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eade8dd4-f0cd-41ad-a607-4ac8444b45a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44c1c01-fe9f-46b0-846d-b49389b5907d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5458145d-bf84-4891-823b-5a1dd32a4f07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:11:41 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:11:41 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d45516-8677-4cbf-a049-ba26acb932d9]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG os_brick.utils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Updating existing volume attachment record: 881ebd35-f14f-4b7e-bec1-593f61faa0ce {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:11:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:42 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Successfully created port: 084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:11:42 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Successfully updated port: 084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:11:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "refresh_cache-4172a681-fc80-4941-9dff-020fa7178f5e" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:11:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquired lock "refresh_cache-4172a681-fc80-4941-9dff-020fa7178f5e" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:11:42 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:11:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-0b2c913f-4946-4f73-bc31-adcf79a15153 req-c26d1c09-ee47-4ec9-b22c-09a730e983eb service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Received event network-changed-084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-0b2c913f-4946-4f73-bc31-adcf79a15153 req-c26d1c09-ee47-4ec9-b22c-09a730e983eb service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Refreshing instance network info cache due to event network-changed-084667a1-7d39-4699-bffd-fe3e2657d588. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:11:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0b2c913f-4946-4f73-bc31-adcf79a15153 req-c26d1c09-ee47-4ec9-b22c-09a730e983eb service nova] Acquiring lock "refresh_cache-4172a681-fc80-4941-9dff-020fa7178f5e" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:11:42 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:11:43 user nova-compute[75469]: DEBUG nova.network.neutron [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Updating instance_info_cache with network_info: [{"id": "084667a1-7d39-4699-bffd-fe3e2657d588", "address": "fa:16:3e:ff:45:e0", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084667a1-7d", "ovs_interfaceid": "084667a1-7d39-4699-bffd-fe3e2657d588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Releasing lock "refresh_cache-4172a681-fc80-4941-9dff-020fa7178f5e" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:11:43 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Instance network_info: |[{"id": "084667a1-7d39-4699-bffd-fe3e2657d588", "address": "fa:16:3e:ff:45:e0", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084667a1-7d", "ovs_interfaceid": "084667a1-7d39-4699-bffd-fe3e2657d588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:11:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0b2c913f-4946-4f73-bc31-adcf79a15153 req-c26d1c09-ee47-4ec9-b22c-09a730e983eb service nova] Acquired lock "refresh_cache-4172a681-fc80-4941-9dff-020fa7178f5e" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:11:43 user nova-compute[75469]: DEBUG nova.network.neutron [req-0b2c913f-4946-4f73-bc31-adcf79a15153 req-c26d1c09-ee47-4ec9-b22c-09a730e983eb service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Refreshing network info cache for port 084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:11:43 user nova-compute[75469]: DEBUG nova.network.neutron [req-0b2c913f-4946-4f73-bc31-adcf79a15153 req-c26d1c09-ee47-4ec9-b22c-09a730e983eb service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Updated VIF entry in instance network info cache for port 084667a1-7d39-4699-bffd-fe3e2657d588. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:11:43 user nova-compute[75469]: DEBUG nova.network.neutron [req-0b2c913f-4946-4f73-bc31-adcf79a15153 req-c26d1c09-ee47-4ec9-b22c-09a730e983eb service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Updating instance_info_cache with network_info: [{"id": "084667a1-7d39-4699-bffd-fe3e2657d588", "address": "fa:16:3e:ff:45:e0", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084667a1-7d", "ovs_interfaceid": "084667a1-7d39-4699-bffd-fe3e2657d588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0b2c913f-4946-4f73-bc31-adcf79a15153 req-c26d1c09-ee47-4ec9-b22c-09a730e983eb service nova] Releasing lock "refresh_cache-4172a681-fc80-4941-9dff-020fa7178f5e" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:11:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:11:46 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Creating image(s)
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Ensure instance console log exists: /opt/stack/data/nova/instances/4172a681-fc80-4941-9dff-020fa7178f5e/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Start _get_guest_xml network_info=[{"id": "084667a1-7d39-4699-bffd-fe3e2657d588", "address": "fa:16:3e:ff:45:e0", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084667a1-7d", "ovs_interfaceid": "084667a1-7d39-4699-bffd-fe3e2657d588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '881ebd35-f14f-4b7e-bec1-593f61faa0ce', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXvSyWTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4172a681-fc80-4941-9dff-020fa7178f5e', 'attached_at': '', 'detached_at': '', 'volume_id': 'abafa81b-179e-47ae-a014-5a2c909c21cf', 'serial': 'abafa81b-179e-47ae-a014-5a2c909c21cf'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:11:46 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:11:46 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXvSyWTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:11:46 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:11:46 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:11:46 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8eac52-5308-4d1c-a348-70ffaee9079c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:11:46 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9c2a9e-2a3a-4718-82d9-e1a23a299b2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf] added
Nov 14 05:11:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ed31fa-3e47-4128-a5bc-361594073176]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c026681-590c-4204-be13-ee47d34ea03b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXvSyWTf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXvSyWTf" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4b9bd8-9552-4b84-972d-1b6fb6c44926]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pXvSyWTf'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e323e686-9e93-43ba-8c6b-b39531733642]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b21180-6e3f-4681-b708-d3f9f12ebd31]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:11:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:11:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[881381a0-4570-49a3-8848-7e8b320f36be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260]
Nov 14 05:11:46 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260] successful.
Nov 14 05:11:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c350bab8-d547-47b0-a9fb-0271512e26c3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5634a3b3-ab80-40ad-83b2-3271be8feff6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:11:46 user nova-compute[75469]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:11:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:11:46 user nova-compute[75469]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:11:46 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[944e700d-5cf2-43a2-844d-05253c2199c3]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXvSyWTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:11:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26562333936646631', 'path': '/dev/sdc'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562333936646631', 'path': '/dev/sdc'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-307068414',display_name='tempest-TestVolumeBootPattern-server-307068414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-307068414',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfogU6kYPcp7NAmuZGDid0UKyqw1IdjLF3ZnJERaUBDZkL+xPoChg6A1IGhqjD7zf4jVDGbb4+dyNskSlHAeBsABrlV8tujEJoboi7nPt7TAeLT6Bss/BpxghYXarJuXw==',key_name='tempest-TestVolumeBootPattern-247749559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-wsfyte9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:11:42Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=4172a681-fc80-4941-9dff-020fa7178f5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084667a1-7d39-4699-bffd-fe3e2657d588", "address": "fa:16:3e:ff:45:e0", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084667a1-7d", "ovs_interfaceid": "084667a1-7d39-4699-bffd-fe3e2657d588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "084667a1-7d39-4699-bffd-fe3e2657d588", "address": "fa:16:3e:ff:45:e0", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084667a1-7d", "ovs_interfaceid": "084667a1-7d39-4699-bffd-fe3e2657d588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:45:e0,bridge_name='br-int',has_traffic_filtering=True,id=084667a1-7d39-4699-bffd-fe3e2657d588,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084667a1-7d') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG nova.objects.instance [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'pci_devices' on Instance uuid 4172a681-fc80-4941-9dff-020fa7178f5e {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:11:47 user nova-compute[75469]:   <uuid>4172a681-fc80-4941-9dff-020fa7178f5e</uuid>
Nov 14 05:11:47 user nova-compute[75469]:   <name>instance-0000002a</name>
Nov 14 05:11:47 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:11:47 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:11:47 user nova-compute[75469]:   <metadata>
Nov 14 05:11:47 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:11:47 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:11:47 user nova-compute[75469]:       <nova:name>tempest-TestVolumeBootPattern-server-307068414</nova:name>
Nov 14 05:11:47 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:11:46</nova:creationTime>
Nov 14 05:11:47 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:11:47 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:11:47 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:11:47 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:11:47 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:11:47 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:11:47 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:11:47 user nova-compute[75469]:       <nova:owner>
Nov 14 05:11:47 user nova-compute[75469]:         <nova:user uuid="0155ca3745514d6c8c0ab08a9182df53">tempest-TestVolumeBootPattern-43343925-project-member</nova:user>
Nov 14 05:11:47 user nova-compute[75469]:         <nova:project uuid="bf022cc839af44ff89e4249410c4a9e4">tempest-TestVolumeBootPattern-43343925</nova:project>
Nov 14 05:11:47 user nova-compute[75469]:       </nova:owner>
Nov 14 05:11:47 user nova-compute[75469]:       <nova:ports>
Nov 14 05:11:47 user nova-compute[75469]:         <nova:port uuid="084667a1-7d39-4699-bffd-fe3e2657d588">
Nov 14 05:11:47 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 05:11:47 user nova-compute[75469]:         </nova:port>
Nov 14 05:11:47 user nova-compute[75469]:       </nova:ports>
Nov 14 05:11:47 user nova-compute[75469]:     </nova:instance>
Nov 14 05:11:47 user nova-compute[75469]:   </metadata>
Nov 14 05:11:47 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:11:47 user nova-compute[75469]:     <system>
Nov 14 05:11:47 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:11:47 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:11:47 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:11:47 user nova-compute[75469]:       <entry name="serial">4172a681-fc80-4941-9dff-020fa7178f5e</entry>
Nov 14 05:11:47 user nova-compute[75469]:       <entry name="uuid">4172a681-fc80-4941-9dff-020fa7178f5e</entry>
Nov 14 05:11:47 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:11:47 user nova-compute[75469]:     </system>
Nov 14 05:11:47 user nova-compute[75469]:   </sysinfo>
Nov 14 05:11:47 user nova-compute[75469]:   <os>
Nov 14 05:11:47 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:11:47 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:11:47 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:11:47 user nova-compute[75469]:   </os>
Nov 14 05:11:47 user nova-compute[75469]:   <features>
Nov 14 05:11:47 user nova-compute[75469]:     <acpi/>
Nov 14 05:11:47 user nova-compute[75469]:     <apic/>
Nov 14 05:11:47 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:11:47 user nova-compute[75469]:   </features>
Nov 14 05:11:47 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:11:47 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:11:47 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:11:47 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:11:47 user nova-compute[75469]:   </clock>
Nov 14 05:11:47 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:11:47 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:11:47 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:11:47 user nova-compute[75469]:   </cpu>
Nov 14 05:11:47 user nova-compute[75469]:   <devices>
Nov 14 05:11:47 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:11:47 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:11:47 user nova-compute[75469]:       <source dev="/dev/sdc"/>
Nov 14 05:11:47 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:11:47 user nova-compute[75469]:       <serial>abafa81b-179e-47ae-a014-5a2c909c21cf</serial>
Nov 14 05:11:47 user nova-compute[75469]:     </disk>
Nov 14 05:11:47 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:11:47 user nova-compute[75469]:       <mac address="fa:16:3e:ff:45:e0"/>
Nov 14 05:11:47 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:11:47 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:11:47 user nova-compute[75469]:       <target dev="tap084667a1-7d"/>
Nov 14 05:11:47 user nova-compute[75469]:     </interface>
Nov 14 05:11:47 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:11:47 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/4172a681-fc80-4941-9dff-020fa7178f5e/console.log" append="off"/>
Nov 14 05:11:47 user nova-compute[75469]:     </serial>
Nov 14 05:11:47 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:11:47 user nova-compute[75469]:     <video>
Nov 14 05:11:47 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:11:47 user nova-compute[75469]:     </video>
Nov 14 05:11:47 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:11:47 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:11:47 user nova-compute[75469]:     </rng>
Nov 14 05:11:47 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:11:47 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:11:47 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:11:47 user nova-compute[75469]:     </memballoon>
Nov 14 05:11:47 user nova-compute[75469]:   </devices>
Nov 14 05:11:47 user nova-compute[75469]: </domain>
Nov 14 05:11:47 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-307068414',display_name='tempest-TestVolumeBootPattern-server-307068414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-307068414',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfogU6kYPcp7NAmuZGDid0UKyqw1IdjLF3ZnJERaUBDZkL+xPoChg6A1IGhqjD7zf4jVDGbb4+dyNskSlHAeBsABrlV8tujEJoboi7nPt7TAeLT6Bss/BpxghYXarJuXw==',key_name='tempest-TestVolumeBootPattern-247749559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-wsfyte9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:11:42Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=4172a681-fc80-4941-9dff-020fa7178f5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084667a1-7d39-4699-bffd-fe3e2657d588", "address": "fa:16:3e:ff:45:e0", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084667a1-7d", "ovs_interfaceid": "084667a1-7d39-4699-bffd-fe3e2657d588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "084667a1-7d39-4699-bffd-fe3e2657d588", "address": "fa:16:3e:ff:45:e0", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084667a1-7d", "ovs_interfaceid": "084667a1-7d39-4699-bffd-fe3e2657d588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:45:e0,bridge_name='br-int',has_traffic_filtering=True,id=084667a1-7d39-4699-bffd-fe3e2657d588,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084667a1-7d') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG os_vif [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:45:e0,bridge_name='br-int',has_traffic_filtering=True,id=084667a1-7d39-4699-bffd-fe3e2657d588,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084667a1-7d') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36cec7fa-44a0-5fdb-9575-1590ff5e7304', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap084667a1-7d, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap084667a1-7d, col_values=(('qos', UUID('6399e443-9189-4036-ac3d-b51008915d11')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap084667a1-7d, col_values=(('external_ids', {'iface-id': '084667a1-7d39-4699-bffd-fe3e2657d588', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:45:e0', 'vm-uuid': '4172a681-fc80-4941-9dff-020fa7178f5e'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:47 user nova-compute[75469]: INFO os_vif [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:45:e0,bridge_name='br-int',has_traffic_filtering=True,id=084667a1-7d39-4699-bffd-fe3e2657d588,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084667a1-7d')
Nov 14 05:11:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:11:47 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No VIF found with MAC fa:16:3e:ff:45:e0, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:11:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-b06d2e50-e752-4db2-9673-c30dbf777d26 req-128ad13e-13f4-4f04-8a0c-496a77c40eac service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Received event network-vif-plugged-084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b06d2e50-e752-4db2-9673-c30dbf777d26 req-128ad13e-13f4-4f04-8a0c-496a77c40eac service nova] Acquiring lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b06d2e50-e752-4db2-9673-c30dbf777d26 req-128ad13e-13f4-4f04-8a0c-496a77c40eac service nova] Lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b06d2e50-e752-4db2-9673-c30dbf777d26 req-128ad13e-13f4-4f04-8a0c-496a77c40eac service nova] Lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-b06d2e50-e752-4db2-9673-c30dbf777d26 req-128ad13e-13f4-4f04-8a0c-496a77c40eac service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] No waiting events found dispatching network-vif-plugged-084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:49 user nova-compute[75469]: WARNING nova.compute.manager [req-b06d2e50-e752-4db2-9673-c30dbf777d26 req-128ad13e-13f4-4f04-8a0c-496a77c40eac service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Received unexpected event network-vif-plugged-084667a1-7d39-4699-bffd-fe3e2657d588 for instance with vm_state building and task_state spawning.
Nov 14 05:11:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:50 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:11:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:11:50 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Instance spawned successfully.
Nov 14 05:11:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:11:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:11:51 user nova-compute[75469]: INFO nova.compute.manager [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 14 05:11:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:11:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-7eebbaa1-3eb7-4334-a6f7-b9f45db7a20d req-02559bb3-a50f-4336-9a67-bc16787f3d5a service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Received event network-vif-plugged-084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7eebbaa1-3eb7-4334-a6f7-b9f45db7a20d req-02559bb3-a50f-4336-9a67-bc16787f3d5a service nova] Acquiring lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7eebbaa1-3eb7-4334-a6f7-b9f45db7a20d req-02559bb3-a50f-4336-9a67-bc16787f3d5a service nova] Lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7eebbaa1-3eb7-4334-a6f7-b9f45db7a20d req-02559bb3-a50f-4336-9a67-bc16787f3d5a service nova] Lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:51 user nova-compute[75469]: DEBUG nova.compute.manager [req-7eebbaa1-3eb7-4334-a6f7-b9f45db7a20d req-02559bb3-a50f-4336-9a67-bc16787f3d5a service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] No waiting events found dispatching network-vif-plugged-084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:51 user nova-compute[75469]: WARNING nova.compute.manager [req-7eebbaa1-3eb7-4334-a6f7-b9f45db7a20d req-02559bb3-a50f-4336-9a67-bc16787f3d5a service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Received unexpected event network-vif-plugged-084667a1-7d39-4699-bffd-fe3e2657d588 for instance with vm_state building and task_state spawning.
Nov 14 05:11:51 user nova-compute[75469]: INFO nova.compute.manager [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Took 10.09 seconds to build instance.
Nov 14 05:11:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cbc022c2-ae93-44ab-9da5-bcc4a8d8fdd6 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "4172a681-fc80-4941-9dff-020fa7178f5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.186s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:55 user nova-compute[75469]: INFO nova.compute.manager [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Terminating instance
Nov 14 05:11:55 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-19ee4261-f078-4a6a-9356-7a49a0e47094 req-8fd71e4e-210e-473d-95b0-3af9a20f519f service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-vif-unplugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19ee4261-f078-4a6a-9356-7a49a0e47094 req-8fd71e4e-210e-473d-95b0-3af9a20f519f service nova] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19ee4261-f078-4a6a-9356-7a49a0e47094 req-8fd71e4e-210e-473d-95b0-3af9a20f519f service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-19ee4261-f078-4a6a-9356-7a49a0e47094 req-8fd71e4e-210e-473d-95b0-3af9a20f519f service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-19ee4261-f078-4a6a-9356-7a49a0e47094 req-8fd71e4e-210e-473d-95b0-3af9a20f519f service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] No waiting events found dispatching network-vif-unplugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-19ee4261-f078-4a6a-9356-7a49a0e47094 req-8fd71e4e-210e-473d-95b0-3af9a20f519f service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-vif-unplugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:11:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Instance destroyed successfully.
Nov 14 05:11:55 user nova-compute[75469]: DEBUG nova.objects.instance [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'resources' on Instance uuid a8ffecbb-5de1-4425-adc5-77fab650b8bf {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T05:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-371085368',display_name='tempest-ServerActionsTestOtherA-server-978815786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-371085368',id=35,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEGTjKqJtkw69dGeCfipwwu89LWWzigSdhele3X3LHWVxYIXIwfNlKlD+XZzmRdKkrwU9RQT/IBBp6eeTDS+MZRGWNM5TH35v1mw59FjYgHxSYncm9QShDeNALd4AjFug==',key_name='tempest-keypair-1304959429',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:08:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-s900r63d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a8ffecbb-5de1-4425-adc5-77fab650b8bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "address": "fa:16:3e:c5:30:3f", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b19d7a7-df", "ovs_interfaceid": "5b19d7a7-df11-4a7b-b994-e62b40a91600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG os_vif [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b19d7a7-df, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96d83e08-e69c-4deb-8d4c-c38b4ab8188a) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:11:55 user nova-compute[75469]: INFO os_vif [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:3f,bridge_name='br-int',has_traffic_filtering=True,id=5b19d7a7-df11-4a7b-b994-e62b40a91600,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b19d7a7-df')
Nov 14 05:11:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Deleting instance files /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf_del
Nov 14 05:11:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Deletion of /opt/stack/data/nova/instances/a8ffecbb-5de1-4425-adc5-77fab650b8bf_del complete
Nov 14 05:11:55 user nova-compute[75469]: INFO nova.compute.manager [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 05:11:55 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:11:55 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:11:56 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:56 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Took 0.71 seconds to deallocate network for instance.
Nov 14 05:11:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:56 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:11:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:11:56 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:11:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:56 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Deleted allocations for instance a8ffecbb-5de1-4425-adc5-77fab650b8bf
Nov 14 05:11:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7c75a035-20bf-4aa8-bae4-1e4df7eecc62 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.014s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-eba430ed-d348-4fbd-bf7a-d6d7ce30b493 req-a34a8fa0-f13a-4960-9cd5-97daf458ec23 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eba430ed-d348-4fbd-bf7a-d6d7ce30b493 req-a34a8fa0-f13a-4960-9cd5-97daf458ec23 service nova] Acquiring lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eba430ed-d348-4fbd-bf7a-d6d7ce30b493 req-a34a8fa0-f13a-4960-9cd5-97daf458ec23 service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eba430ed-d348-4fbd-bf7a-d6d7ce30b493 req-a34a8fa0-f13a-4960-9cd5-97daf458ec23 service nova] Lock "a8ffecbb-5de1-4425-adc5-77fab650b8bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-eba430ed-d348-4fbd-bf7a-d6d7ce30b493 req-a34a8fa0-f13a-4960-9cd5-97daf458ec23 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] No waiting events found dispatching network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:11:57 user nova-compute[75469]: WARNING nova.compute.manager [req-eba430ed-d348-4fbd-bf7a-d6d7ce30b493 req-a34a8fa0-f13a-4960-9cd5-97daf458ec23 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received unexpected event network-vif-plugged-5b19d7a7-df11-4a7b-b994-e62b40a91600 for instance with vm_state deleted and task_state None.
Nov 14 05:11:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-eba430ed-d348-4fbd-bf7a-d6d7ce30b493 req-a34a8fa0-f13a-4960-9cd5-97daf458ec23 service nova] [instance: a8ffecbb-5de1-4425-adc5-77fab650b8bf] Received event network-vif-deleted-5b19d7a7-df11-4a7b-b994-e62b40a91600 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updating instance_info_cache with network_info: [{"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:11:57 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:11:59 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:11:59 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:11:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8220MB free_disk=24.834712982177734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 87874095-a320-4445-8dd3-b7b259764dfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance e74a9e8f-2e86-4de9-9d39-5192cf5763c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 67ad2387-630f-4066-b1eb-5c915b16232f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4172a681-fc80-4941-9dff-020fa7178f5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:11:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:12:00 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:12:00 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:12:00 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:12:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:02 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:12:02 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:12:02 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:12:02 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:12:03 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:12:04 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:12:04 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:12:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:12:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:12:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-d21d3b5f-bcd8-4758-a1d6-1a4133afaafa req-b40160f1-3c8e-4626-94bb-023688a9da31 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received event network-changed-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-d21d3b5f-bcd8-4758-a1d6-1a4133afaafa req-b40160f1-3c8e-4626-94bb-023688a9da31 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Refreshing instance network info cache due to event network-changed-e410b203-a06b-4d47-b021-cd273d307573. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d21d3b5f-bcd8-4758-a1d6-1a4133afaafa req-b40160f1-3c8e-4626-94bb-023688a9da31 service nova] Acquiring lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d21d3b5f-bcd8-4758-a1d6-1a4133afaafa req-b40160f1-3c8e-4626-94bb-023688a9da31 service nova] Acquired lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG nova.network.neutron [req-d21d3b5f-bcd8-4758-a1d6-1a4133afaafa req-b40160f1-3c8e-4626-94bb-023688a9da31 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Refreshing network info cache for port e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "87874095-a320-4445-8dd3-b7b259764dfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "87874095-a320-4445-8dd3-b7b259764dfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:13 user nova-compute[75469]: INFO nova.compute.manager [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Terminating instance
Nov 14 05:12:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-3a31dbeb-8d22-4a1a-b3da-a5d9e4f56f71 req-c227e664-e5aa-4c80-9076-9bb40bafaba4 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received event network-vif-unplugged-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3a31dbeb-8d22-4a1a-b3da-a5d9e4f56f71 req-c227e664-e5aa-4c80-9076-9bb40bafaba4 service nova] Acquiring lock "87874095-a320-4445-8dd3-b7b259764dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3a31dbeb-8d22-4a1a-b3da-a5d9e4f56f71 req-c227e664-e5aa-4c80-9076-9bb40bafaba4 service nova] Lock "87874095-a320-4445-8dd3-b7b259764dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3a31dbeb-8d22-4a1a-b3da-a5d9e4f56f71 req-c227e664-e5aa-4c80-9076-9bb40bafaba4 service nova] Lock "87874095-a320-4445-8dd3-b7b259764dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-3a31dbeb-8d22-4a1a-b3da-a5d9e4f56f71 req-c227e664-e5aa-4c80-9076-9bb40bafaba4 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] No waiting events found dispatching network-vif-unplugged-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:12:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-3a31dbeb-8d22-4a1a-b3da-a5d9e4f56f71 req-c227e664-e5aa-4c80-9076-9bb40bafaba4 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received event network-vif-unplugged-e410b203-a06b-4d47-b021-cd273d307573 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG nova.network.neutron [req-d21d3b5f-bcd8-4758-a1d6-1a4133afaafa req-b40160f1-3c8e-4626-94bb-023688a9da31 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Updated VIF entry in instance network info cache for port e410b203-a06b-4d47-b021-cd273d307573. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG nova.network.neutron [req-d21d3b5f-bcd8-4758-a1d6-1a4133afaafa req-b40160f1-3c8e-4626-94bb-023688a9da31 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Updating instance_info_cache with network_info: [{"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-d21d3b5f-bcd8-4758-a1d6-1a4133afaafa req-b40160f1-3c8e-4626-94bb-023688a9da31 service nova] Releasing lock "refresh_cache-87874095-a320-4445-8dd3-b7b259764dfa" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:12:14 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Instance destroyed successfully.
Nov 14 05:12:14 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lazy-loading 'resources' on Instance uuid 87874095-a320-4445-8dd3-b7b259764dfa {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-610960302',display_name='tempest-TestStampPattern-server-610960302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-610960302',id=33,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIbprXKukdzTIGKQy5CdrYJsNjT3KMcr1m2DCPZxsN4W045qdvgMW40zZ6YaNfSahpFUhbzXXXrWBXhMt7BGmhkttHYyfVM1bsmzIIYbrZC/EfH3ShlUu1reGi0vZx7ZQ==',key_name='tempest-TestStampPattern-1132364811',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:05:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a227a14762d241479644c6bfdf340bee',ramdisk_id='',reservation_id='r-1dh873ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1299350604',owner_user_name='tempest-TestStampPattern-1299350604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:08:25Z,user_data=None,user_id='aee00a8861b64c90aef13e13ca17b8d0',uuid=87874095-a320-4445-8dd3-b7b259764dfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converting VIF {"id": "e410b203-a06b-4d47-b021-cd273d307573", "address": "fa:16:3e:6f:cf:ad", "network": {"id": "974cab23-1964-4441-83da-9278cbb0169e", "bridge": "br-int", "label": "tempest-TestStampPattern-755189127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a227a14762d241479644c6bfdf340bee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape410b203-a0", "ovs_interfaceid": "e410b203-a06b-4d47-b021-cd273d307573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=e410b203-a06b-4d47-b021-cd273d307573,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape410b203-a0') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG os_vif [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=e410b203-a06b-4d47-b021-cd273d307573,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape410b203-a0') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape410b203-a0, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7074e6ed-2d0b-4372-b673-16a737b72330) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:12:14 user nova-compute[75469]: INFO os_vif [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=e410b203-a06b-4d47-b021-cd273d307573,network=Network(974cab23-1964-4441-83da-9278cbb0169e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape410b203-a0')
Nov 14 05:12:14 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Deleting instance files /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa_del
Nov 14 05:12:14 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Deletion of /opt/stack/data/nova/instances/87874095-a320-4445-8dd3-b7b259764dfa_del complete
Nov 14 05:12:14 user nova-compute[75469]: INFO nova.compute.manager [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 05:12:14 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:12:14 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:12:15 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:12:15 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Took 0.88 seconds to deallocate network for instance.
Nov 14 05:12:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-9d7cbb19-132a-4782-b520-70311179296c req-dc92351e-26ed-485c-bd30-c7e706daf427 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received event network-vif-deleted-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:15 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:12:15 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:12:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:15 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Deleted allocations for instance 87874095-a320-4445-8dd3-b7b259764dfa
Nov 14 05:12:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee85317a-8f37-40e2-815c-358979f35f08 tempest-TestStampPattern-1299350604 tempest-TestStampPattern-1299350604-project-member] Lock "87874095-a320-4445-8dd3-b7b259764dfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.108s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-2f656386-3110-4b63-a394-b88740c5a4ad req-fec156be-7191-43c8-9018-e8ac9ecc7c54 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received event network-vif-plugged-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f656386-3110-4b63-a394-b88740c5a4ad req-fec156be-7191-43c8-9018-e8ac9ecc7c54 service nova] Acquiring lock "87874095-a320-4445-8dd3-b7b259764dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f656386-3110-4b63-a394-b88740c5a4ad req-fec156be-7191-43c8-9018-e8ac9ecc7c54 service nova] Lock "87874095-a320-4445-8dd3-b7b259764dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2f656386-3110-4b63-a394-b88740c5a4ad req-fec156be-7191-43c8-9018-e8ac9ecc7c54 service nova] Lock "87874095-a320-4445-8dd3-b7b259764dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-2f656386-3110-4b63-a394-b88740c5a4ad req-fec156be-7191-43c8-9018-e8ac9ecc7c54 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] No waiting events found dispatching network-vif-plugged-e410b203-a06b-4d47-b021-cd273d307573 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:12:15 user nova-compute[75469]: WARNING nova.compute.manager [req-2f656386-3110-4b63-a394-b88740c5a4ad req-fec156be-7191-43c8-9018-e8ac9ecc7c54 service nova] [instance: 87874095-a320-4445-8dd3-b7b259764dfa] Received unexpected event network-vif-plugged-e410b203-a06b-4d47-b021-cd273d307573 for instance with vm_state deleted and task_state None.
Nov 14 05:12:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "c4a6a311-e640-471c-9b63-39d3a32a2796" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:12:26 user nova-compute[75469]: INFO nova.compute.claims [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Claim successful on node user
Nov 14 05:12:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:12:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:12:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:12:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG nova.policy [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c8bacf3e4d54f8fb27f84f87c693e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fc8e6026a4487b9288b15dee67072f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:12:27 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Creating image(s)
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "/opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "/opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.166s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.165s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk 1073741824" returned: 0 in 0.048s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Successfully created port: 982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Cannot resize image /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Ensure instance console log exists: /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Successfully updated port: 982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquired lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.compute.manager [req-6540dd6d-9520-460c-a20c-0815ec06c12a req-ccfcaced-d87d-4b73-84ca-acf2520d7876 service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Received event network-changed-982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.compute.manager [req-6540dd6d-9520-460c-a20c-0815ec06c12a req-ccfcaced-d87d-4b73-84ca-acf2520d7876 service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Refreshing instance network info cache due to event network-changed-982e8525-a8d0-45ca-848a-4aee702453bd. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6540dd6d-9520-460c-a20c-0815ec06c12a req-ccfcaced-d87d-4b73-84ca-acf2520d7876 service nova] Acquiring lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Updating instance_info_cache with network_info: [{"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Releasing lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Instance network_info: |[{"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6540dd6d-9520-460c-a20c-0815ec06c12a req-ccfcaced-d87d-4b73-84ca-acf2520d7876 service nova] Acquired lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-6540dd6d-9520-460c-a20c-0815ec06c12a req-ccfcaced-d87d-4b73-84ca-acf2520d7876 service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Refreshing network info cache for port 982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Start _get_guest_xml network_info=[{"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:12:28 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:12:28 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1932536143',display_name='tempest-ServersNegativeTestJSON-server-1932536143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1932536143',id=43,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39fc8e6026a4487b9288b15dee67072f',ramdisk_id='',reservation_id='r-yfwfoknd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1402505206',owner_user_name='tempest-ServersNegativeTestJSON-1402505206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:12:27Z,user_data=None,user_id='7c8bacf3e4d54f8fb27f84f87c693e11',uuid=c4a6a311-e640-471c-9b63-39d3a32a2796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converting VIF {"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=982e8525-a8d0-45ca-848a-4aee702453bd,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982e8525-a8') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lazy-loading 'pci_devices' on Instance uuid c4a6a311-e640-471c-9b63-39d3a32a2796 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:12:28 user nova-compute[75469]:   <uuid>c4a6a311-e640-471c-9b63-39d3a32a2796</uuid>
Nov 14 05:12:28 user nova-compute[75469]:   <name>instance-0000002b</name>
Nov 14 05:12:28 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:12:28 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:12:28 user nova-compute[75469]:   <metadata>
Nov 14 05:12:28 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:12:28 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:12:28 user nova-compute[75469]:       <nova:name>tempest-ServersNegativeTestJSON-server-1932536143</nova:name>
Nov 14 05:12:28 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:12:28</nova:creationTime>
Nov 14 05:12:28 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:12:28 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:12:28 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:12:28 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:12:28 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:12:28 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:12:28 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:12:28 user nova-compute[75469]:       <nova:owner>
Nov 14 05:12:28 user nova-compute[75469]:         <nova:user uuid="7c8bacf3e4d54f8fb27f84f87c693e11">tempest-ServersNegativeTestJSON-1402505206-project-member</nova:user>
Nov 14 05:12:28 user nova-compute[75469]:         <nova:project uuid="39fc8e6026a4487b9288b15dee67072f">tempest-ServersNegativeTestJSON-1402505206</nova:project>
Nov 14 05:12:28 user nova-compute[75469]:       </nova:owner>
Nov 14 05:12:28 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:12:28 user nova-compute[75469]:       <nova:ports>
Nov 14 05:12:28 user nova-compute[75469]:         <nova:port uuid="982e8525-a8d0-45ca-848a-4aee702453bd">
Nov 14 05:12:28 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 05:12:28 user nova-compute[75469]:         </nova:port>
Nov 14 05:12:28 user nova-compute[75469]:       </nova:ports>
Nov 14 05:12:28 user nova-compute[75469]:     </nova:instance>
Nov 14 05:12:28 user nova-compute[75469]:   </metadata>
Nov 14 05:12:28 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:12:28 user nova-compute[75469]:     <system>
Nov 14 05:12:28 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:12:28 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:12:28 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:12:28 user nova-compute[75469]:       <entry name="serial">c4a6a311-e640-471c-9b63-39d3a32a2796</entry>
Nov 14 05:12:28 user nova-compute[75469]:       <entry name="uuid">c4a6a311-e640-471c-9b63-39d3a32a2796</entry>
Nov 14 05:12:28 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:12:28 user nova-compute[75469]:     </system>
Nov 14 05:12:28 user nova-compute[75469]:   </sysinfo>
Nov 14 05:12:28 user nova-compute[75469]:   <os>
Nov 14 05:12:28 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:12:28 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:12:28 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:12:28 user nova-compute[75469]:   </os>
Nov 14 05:12:28 user nova-compute[75469]:   <features>
Nov 14 05:12:28 user nova-compute[75469]:     <acpi/>
Nov 14 05:12:28 user nova-compute[75469]:     <apic/>
Nov 14 05:12:28 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:12:28 user nova-compute[75469]:   </features>
Nov 14 05:12:28 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:12:28 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:12:28 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:12:28 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:12:28 user nova-compute[75469]:   </clock>
Nov 14 05:12:28 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:12:28 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:12:28 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:12:28 user nova-compute[75469]:   </cpu>
Nov 14 05:12:28 user nova-compute[75469]:   <devices>
Nov 14 05:12:28 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:12:28 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:12:28 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk"/>
Nov 14 05:12:28 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:12:28 user nova-compute[75469]:     </disk>
Nov 14 05:12:28 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:12:28 user nova-compute[75469]:       <mac address="fa:16:3e:10:0a:c4"/>
Nov 14 05:12:28 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:12:28 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:12:28 user nova-compute[75469]:       <target dev="tap982e8525-a8"/>
Nov 14 05:12:28 user nova-compute[75469]:     </interface>
Nov 14 05:12:28 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:12:28 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/console.log" append="off"/>
Nov 14 05:12:28 user nova-compute[75469]:     </serial>
Nov 14 05:12:28 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:12:28 user nova-compute[75469]:     <video>
Nov 14 05:12:28 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:12:28 user nova-compute[75469]:     </video>
Nov 14 05:12:28 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:12:28 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:12:28 user nova-compute[75469]:     </rng>
Nov 14 05:12:28 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:12:28 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:12:28 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:12:28 user nova-compute[75469]:     </memballoon>
Nov 14 05:12:28 user nova-compute[75469]:   </devices>
Nov 14 05:12:28 user nova-compute[75469]: </domain>
Nov 14 05:12:28 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1932536143',display_name='tempest-ServersNegativeTestJSON-server-1932536143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1932536143',id=43,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39fc8e6026a4487b9288b15dee67072f',ramdisk_id='',reservation_id='r-yfwfoknd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1402505206',owner_user_name='tempest-ServersNegativeTestJSON-1402505206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:12:27Z,user_data=None,user_id='7c8bacf3e4d54f8fb27f84f87c693e11',uuid=c4a6a311-e640-471c-9b63-39d3a32a2796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converting VIF {"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=982e8525-a8d0-45ca-848a-4aee702453bd,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982e8525-a8') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG os_vif [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=982e8525-a8d0-45ca-848a-4aee702453bd,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982e8525-a8') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4928ce8d-99a4-5e43-9a2c-d74d6f14a15a', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap982e8525-a8, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap982e8525-a8, col_values=(('qos', UUID('92691300-b403-48a5-97fa-386b2973e9d6')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap982e8525-a8, col_values=(('external_ids', {'iface-id': '982e8525-a8d0-45ca-848a-4aee702453bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:0a:c4', 'vm-uuid': 'c4a6a311-e640-471c-9b63-39d3a32a2796'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:28 user nova-compute[75469]: INFO os_vif [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=982e8525-a8d0-45ca-848a-4aee702453bd,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982e8525-a8')
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] No VIF found with MAC fa:16:3e:10:0a:c4, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-6540dd6d-9520-460c-a20c-0815ec06c12a req-ccfcaced-d87d-4b73-84ca-acf2520d7876 service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Updated VIF entry in instance network info cache for port 982e8525-a8d0-45ca-848a-4aee702453bd. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-6540dd6d-9520-460c-a20c-0815ec06c12a req-ccfcaced-d87d-4b73-84ca-acf2520d7876 service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Updating instance_info_cache with network_info: [{"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:12:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-6540dd6d-9520-460c-a20c-0815ec06c12a req-ccfcaced-d87d-4b73-84ca-acf2520d7876 service nova] Releasing lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:12:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:12:32 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Instance spawned successfully.
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:12:32 user nova-compute[75469]: INFO nova.compute.manager [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:12:32 user nova-compute[75469]: INFO nova.compute.manager [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Took 5.68 seconds to build instance.
Nov 14 05:12:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ee325798-5590-4c80-b347-44e5ba59b968 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.779s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-b8fafb71-a5b8-4ac8-b77a-6207a3e826fe req-253d1906-4d58-45a1-961e-be279816096a service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Received event network-vif-plugged-982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b8fafb71-a5b8-4ac8-b77a-6207a3e826fe req-253d1906-4d58-45a1-961e-be279816096a service nova] Acquiring lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b8fafb71-a5b8-4ac8-b77a-6207a3e826fe req-253d1906-4d58-45a1-961e-be279816096a service nova] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b8fafb71-a5b8-4ac8-b77a-6207a3e826fe req-253d1906-4d58-45a1-961e-be279816096a service nova] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:32 user nova-compute[75469]: DEBUG nova.compute.manager [req-b8fafb71-a5b8-4ac8-b77a-6207a3e826fe req-253d1906-4d58-45a1-961e-be279816096a service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] No waiting events found dispatching network-vif-plugged-982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:12:32 user nova-compute[75469]: WARNING nova.compute.manager [req-b8fafb71-a5b8-4ac8-b77a-6207a3e826fe req-253d1906-4d58-45a1-961e-be279816096a service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Received unexpected event network-vif-plugged-982e8525-a8d0-45ca-848a-4aee702453bd for instance with vm_state active and task_state None.
Nov 14 05:12:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-3d66a4f5-26ac-4a9a-8a92-8cfb67e92ea9 req-2c1b882d-1a70-4466-8ef3-9910506aa230 service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Received event network-vif-plugged-982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3d66a4f5-26ac-4a9a-8a92-8cfb67e92ea9 req-2c1b882d-1a70-4466-8ef3-9910506aa230 service nova] Acquiring lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3d66a4f5-26ac-4a9a-8a92-8cfb67e92ea9 req-2c1b882d-1a70-4466-8ef3-9910506aa230 service nova] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3d66a4f5-26ac-4a9a-8a92-8cfb67e92ea9 req-2c1b882d-1a70-4466-8ef3-9910506aa230 service nova] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-3d66a4f5-26ac-4a9a-8a92-8cfb67e92ea9 req-2c1b882d-1a70-4466-8ef3-9910506aa230 service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] No waiting events found dispatching network-vif-plugged-982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:12:34 user nova-compute[75469]: WARNING nova.compute.manager [req-3d66a4f5-26ac-4a9a-8a92-8cfb67e92ea9 req-2c1b882d-1a70-4466-8ef3-9910506aa230 service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Received unexpected event network-vif-plugged-982e8525-a8d0-45ca-848a-4aee702453bd for instance with vm_state active and task_state None.
Nov 14 05:12:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-490d5932-b825-4334-b93d-0fb5a1d42415 req-5476684a-05be-4041-af4b-ae1c4c43de44 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-changed-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-490d5932-b825-4334-b93d-0fb5a1d42415 req-5476684a-05be-4041-af4b-ae1c4c43de44 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Refreshing instance network info cache due to event network-changed-c3c21b15-f830-41d9-a5b6-242a097ac43d. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-490d5932-b825-4334-b93d-0fb5a1d42415 req-5476684a-05be-4041-af4b-ae1c4c43de44 service nova] Acquiring lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-490d5932-b825-4334-b93d-0fb5a1d42415 req-5476684a-05be-4041-af4b-ae1c4c43de44 service nova] Acquired lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG nova.network.neutron [req-490d5932-b825-4334-b93d-0fb5a1d42415 req-5476684a-05be-4041-af4b-ae1c4c43de44 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Refreshing network info cache for port c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:55 user nova-compute[75469]: INFO nova.compute.manager [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Terminating instance
Nov 14 05:12:55 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Instance destroyed successfully.
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.objects.instance [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lazy-loading 'resources' on Instance uuid e74a9e8f-2e86-4de9-9d39-5192cf5763c5 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T05:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2116243024',display_name='tempest-TestShelveInstance-server-2116243024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2116243024',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0Qas8BH6l6FqQNvGoTG+Iy1AxUhx83WtDJZDKWmaIXfJT4oouE9iO/yf9IlPc8wEtovlgdDqLYXUh2SCgAu1eJ4kPF7B3On30+g0vXPcFEBA/m60Gz6wl1aUtqlaIm5w==',key_name='tempest-TestShelveInstance-848916377',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e916ef90975b40bdb9a887d02e4770dd',ramdisk_id='',reservation_id='r-qjebm1o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1973652568',owner_user_name='tempest-TestShelveInstance-1973652568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:11:15Z,user_data=None,user_id='6212f1c3188246c6b94e3ad485d6174f',uuid=e74a9e8f-2e86-4de9-9d39-5192cf5763c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converting VIF {"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_vif [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3c21b15-f8, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7dc59dd0-2e8e-4353-84de-0ef1113a2c58) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: INFO os_vif [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=c3c21b15-f830-41d9-a5b6-242a097ac43d,network=Network(389c3979-8960-4d2d-a251-401dba136bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c21b15-f8')
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnfNGRUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:12:56 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.compute.manager [req-ce0816f3-6def-46d8-a54c-651b11f039f5 req-06fbf651-a334-4114-9f6b-a558f690cf1a service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-unplugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ce0816f3-6def-46d8-a54c-651b11f039f5 req-06fbf651-a334-4114-9f6b-a558f690cf1a service nova] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ce0816f3-6def-46d8-a54c-651b11f039f5 req-06fbf651-a334-4114-9f6b-a558f690cf1a service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ce0816f3-6def-46d8-a54c-651b11f039f5 req-06fbf651-a334-4114-9f6b-a558f690cf1a service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.compute.manager [req-ce0816f3-6def-46d8-a54c-651b11f039f5 req-06fbf651-a334-4114-9f6b-a558f690cf1a service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] No waiting events found dispatching network-vif-unplugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.compute.manager [req-ce0816f3-6def-46d8-a54c-651b11f039f5 req-06fbf651-a334-4114-9f6b-a558f690cf1a service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-unplugged-c3c21b15-f830-41d9-a5b6-242a097ac43d for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92401e5-1059-4537-8daa-aa1dce61e318]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:12:56 user nova-compute[75469]: No targets found.
Nov 14 05:12:56 user nova-compute[75469]: iSNS:
Nov 14 05:12:56 user nova-compute[75469]: No targets found.
Nov 14 05:12:56 user nova-compute[75469]: STATIC:
Nov 14 05:12:56 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf
Nov 14 05:12:56 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:12:56 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:12:56 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088
Nov 14 05:12:56 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:12:56 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:12:56 user nova-compute[75469]: FIRMWARE:
Nov 14 05:12:56 user nova-compute[75469]: No targets found.
Nov 14 05:12:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:12:56 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:12:56 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c565dda6-40ab-42d4-830c-4b9b53dce281]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd54a04-9ab2-41ed-9088-7af3ef58930f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:12:56 user nova-compute[75469]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:12:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 (non-flash)
Nov 14 05:12:56 user nova-compute[75469]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:12:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa74c3c0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8a747e-6746-4edd-b466-315c42913eac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7df1e0-78e3-4a90-975a-90c5510c2f4e]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f0a93-ac25-4ec0-83e0-0a070ed3c806]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.network.neutron [req-490d5932-b825-4334-b93d-0fb5a1d42415 req-5476684a-05be-4041-af4b-ae1c4c43de44 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updated VIF entry in instance network info cache for port c3c21b15-f830-41d9-a5b6-242a097ac43d. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.network.neutron [req-490d5932-b825-4334-b93d-0fb5a1d42415 req-5476684a-05be-4041-af4b-ae1c4c43de44 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating instance_info_cache with network_info: [{"id": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "address": "fa:16:3e:4b:d4:04", "network": {"id": "389c3979-8960-4d2d-a251-401dba136bf5", "bridge": "br-int", "label": "tempest-TestShelveInstance-538544462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e916ef90975b40bdb9a887d02e4770dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c21b15-f8", "ovs_interfaceid": "c3c21b15-f830-41d9-a5b6-242a097ac43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[95863699-aa4c-4a79-be1b-e0f65f34c368]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-490d5932-b825-4334-b93d-0fb5a1d42415 req-5476684a-05be-4041-af4b-ae1c4c43de44 service nova] Releasing lock "refresh_cache-e74a9e8f-2e86-4de9-9d39-5192cf5763c5" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7ba87e-33ec-471a-9128-1d6d92db6f43]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[068bd9d4-c66a-4cee-983e-99211bb59d16]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260]
Nov 14 05:12:56 user nova-compute[75469]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088, portal: 172.16.0.220,3260] successful.
Nov 14 05:12:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729b4621-6005-4246-b7bc-58b8d80f0088 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[903426d8-ec08-4335-95d1-acd962df9531]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.458s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] <== disconnect_volume: return (458ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:12:56 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Deleting instance files /opt/stack/data/nova/instances/e74a9e8f-2e86-4de9-9d39-5192cf5763c5_del
Nov 14 05:12:56 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Deletion of /opt/stack/data/nova/instances/e74a9e8f-2e86-4de9-9d39-5192cf5763c5_del complete
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: INFO nova.compute.manager [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 14 05:12:56 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:12:57 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:12:57 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Took 0.77 seconds to deallocate network for instance.
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:58 user nova-compute[75469]: INFO nova.compute.manager [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Took 0.76 seconds to detach 1 volumes for instance.
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.manager [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Deleting volume: 729b4621-6005-4246-b7bc-58b8d80f0088 {{(pid=75469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] No waiting events found dispatching network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:12:58 user nova-compute[75469]: WARNING nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received unexpected event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d for instance with vm_state active and task_state deleting.
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] No waiting events found dispatching network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:12:58 user nova-compute[75469]: WARNING nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received unexpected event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d for instance with vm_state active and task_state deleting.
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] No waiting events found dispatching network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:12:58 user nova-compute[75469]: WARNING nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received unexpected event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d for instance with vm_state active and task_state deleting.
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Acquiring lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] No waiting events found dispatching network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:12:58 user nova-compute[75469]: WARNING nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received unexpected event network-vif-plugged-c3c21b15-f830-41d9-a5b6-242a097ac43d for instance with vm_state active and task_state deleting.
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-1db5e424-576c-49b0-b74f-5ece29ebf61e req-a0ecf95c-5b31-4c64-a7ed-440526455aa5 service nova] [instance: e74a9e8f-2e86-4de9-9d39-5192cf5763c5] Received event network-vif-deleted-c3c21b15-f830-41d9-a5b6-242a097ac43d {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:12:58 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.528s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:59 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Deleted allocations for instance e74a9e8f-2e86-4de9-9d39-5192cf5763c5
Nov 14 05:12:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-2b258ace-c062-4fa8-9017-4a18e43a1e56 tempest-TestShelveInstance-1973652568 tempest-TestShelveInstance-1973652568-project-member] Lock "e74a9e8f-2e86-4de9-9d39-5192cf5763c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.758s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:12:59 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:12:59 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:12:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8308MB free_disk=24.927955627441406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 67ad2387-630f-4066-b1eb-5c915b16232f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4172a681-fc80-4941-9dff-020fa7178f5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c4a6a311-e640-471c-9b63-39d3a32a2796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:12:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:13:00 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:13:00 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:13:00 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:13:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:01 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:13:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 05:13:01 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:01 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:13:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:04 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:04 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 05:13:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:07 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:07 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:12 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:21 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 05:13:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 05:13:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG nova.objects.instance [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'flavor' on Instance uuid 67ad2387-630f-4066-b1eb-5c915b16232f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:24 user nova-compute[75469]: INFO nova.compute.manager [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Attaching volume b8102898-86af-4719-8b93-53819d13d249 to /dev/vdb
Nov 14 05:13:24 user nova-compute[75469]: DEBUG os_brick.utils [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0ac54c-731a-44c2-b7f1-5b9b29b7b28a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3302d63-a08b-405f-b2a3-412038b609e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[030cfb07-d270-40b8-9103-f751e7907bf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[547be2d3-40b9-4857-98e2-59bc7dd6aaaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:13:24 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:13:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d995cac9-0508-4387-92da-b4d9da93dc70]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG os_brick.utils [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:13:24 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updating existing volume attachment record: ba99adaf-e909-4822-af57-05895f337377 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:13:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKoHIpeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:13:29 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:13:29 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:13:29 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5997a60-cf26-40ea-8b99-ef7f030103d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:13:29 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a8412c-1289-4f5c-88d2-f80e7387f220]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249] added
Nov 14 05:13:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e6337d-9716-4102-bc07-82e74ca7f116]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5233a1d5-490c-4916-abaa-bcfd2bab757b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKoHIpeR {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKoHIpeR" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8135603-f038-44d9-90e2-c68621d1a35e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iKoHIpeR'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b622fff-debb-445a-9a34-2457fc2f37fa]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a362d94-3d83-417d-ac4e-8cdc6aec1854]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:13:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:13:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4e5744-08d8-45fe-a561-044d066851ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260]
Nov 14 05:13:29 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260] successful.
Nov 14 05:13:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d22ffc-e906-43e1-b244-978fa712df82]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44f1bc4-b3b8-4fb2-92e6-3aead149fbac]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:13:29 user nova-compute[75469]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:13:29 user nova-compute[75469]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:29 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9331f4f7-d9bd-456c-938a-2a503496a4db]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:29 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:13:30 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:13:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKoHIpeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:13:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:13:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23261393339396639', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:13:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261393339396639', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:13:30 user nova-compute[75469]: DEBUG nova.objects.instance [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'flavor' on Instance uuid 67ad2387-630f-4066-b1eb-5c915b16232f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:13:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:13:30 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:13:30 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:13:30 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:13:30 user nova-compute[75469]:   <serial>b8102898-86af-4719-8b93-53819d13d249</serial>
Nov 14 05:13:30 user nova-compute[75469]: </disk>
Nov 14 05:13:30 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:13:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:13:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:13:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] No VIF found with MAC fa:16:3e:9a:ba:f5, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:13:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f76a8437-9ded-4c8e-86ca-9a13a30d2b04 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.218s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG nova.compute.manager [req-c7724b7a-982e-4a3b-a5cd-b3b1642448a5 req-0b3be80c-5e2e-43ea-a464-677d72760b4f service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Received event network-changed-084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG nova.compute.manager [req-c7724b7a-982e-4a3b-a5cd-b3b1642448a5 req-0b3be80c-5e2e-43ea-a464-677d72760b4f service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Refreshing instance network info cache due to event network-changed-084667a1-7d39-4699-bffd-fe3e2657d588. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c7724b7a-982e-4a3b-a5cd-b3b1642448a5 req-0b3be80c-5e2e-43ea-a464-677d72760b4f service nova] Acquiring lock "refresh_cache-4172a681-fc80-4941-9dff-020fa7178f5e" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c7724b7a-982e-4a3b-a5cd-b3b1642448a5 req-0b3be80c-5e2e-43ea-a464-677d72760b4f service nova] Acquired lock "refresh_cache-4172a681-fc80-4941-9dff-020fa7178f5e" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG nova.network.neutron [req-c7724b7a-982e-4a3b-a5cd-b3b1642448a5 req-0b3be80c-5e2e-43ea-a464-677d72760b4f service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Refreshing network info cache for port 084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "4172a681-fc80-4941-9dff-020fa7178f5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "4172a681-fc80-4941-9dff-020fa7178f5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:33 user nova-compute[75469]: INFO nova.compute.manager [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Terminating instance
Nov 14 05:13:33 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.network.neutron [req-c7724b7a-982e-4a3b-a5cd-b3b1642448a5 req-0b3be80c-5e2e-43ea-a464-677d72760b4f service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Updated VIF entry in instance network info cache for port 084667a1-7d39-4699-bffd-fe3e2657d588. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.network.neutron [req-c7724b7a-982e-4a3b-a5cd-b3b1642448a5 req-0b3be80c-5e2e-43ea-a464-677d72760b4f service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Updating instance_info_cache with network_info: [{"id": "084667a1-7d39-4699-bffd-fe3e2657d588", "address": "fa:16:3e:ff:45:e0", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084667a1-7d", "ovs_interfaceid": "084667a1-7d39-4699-bffd-fe3e2657d588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c7724b7a-982e-4a3b-a5cd-b3b1642448a5 req-0b3be80c-5e2e-43ea-a464-677d72760b4f service nova] Releasing lock "refresh_cache-4172a681-fc80-4941-9dff-020fa7178f5e" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-7a72401e-d023-413e-969b-5c16ac840f84 req-c209628f-0ea6-43b7-9388-0d54f16fad92 service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Received event network-vif-unplugged-084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7a72401e-d023-413e-969b-5c16ac840f84 req-c209628f-0ea6-43b7-9388-0d54f16fad92 service nova] Acquiring lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7a72401e-d023-413e-969b-5c16ac840f84 req-c209628f-0ea6-43b7-9388-0d54f16fad92 service nova] Lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7a72401e-d023-413e-969b-5c16ac840f84 req-c209628f-0ea6-43b7-9388-0d54f16fad92 service nova] Lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-7a72401e-d023-413e-969b-5c16ac840f84 req-c209628f-0ea6-43b7-9388-0d54f16fad92 service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] No waiting events found dispatching network-vif-unplugged-084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-7a72401e-d023-413e-969b-5c16ac840f84 req-c209628f-0ea6-43b7-9388-0d54f16fad92 service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Received event network-vif-unplugged-084667a1-7d39-4699-bffd-fe3e2657d588 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-91acd8ec-567f-48cd-965c-28dc9e34020d req-b90c6298-e0f0-464c-a62d-071d296c04c6 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-changed-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.compute.manager [req-91acd8ec-567f-48cd-965c-28dc9e34020d req-b90c6298-e0f0-464c-a62d-071d296c04c6 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Refreshing instance network info cache due to event network-changed-37573211-71cc-4684-8d46-5ed2ee9ffae7. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-91acd8ec-567f-48cd-965c-28dc9e34020d req-b90c6298-e0f0-464c-a62d-071d296c04c6 service nova] Acquiring lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-91acd8ec-567f-48cd-965c-28dc9e34020d req-b90c6298-e0f0-464c-a62d-071d296c04c6 service nova] Acquired lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.network.neutron [req-91acd8ec-567f-48cd-965c-28dc9e34020d req-b90c6298-e0f0-464c-a62d-071d296c04c6 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Refreshing network info cache for port 37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:13:34 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Instance destroyed successfully.
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.objects.instance [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'resources' on Instance uuid 4172a681-fc80-4941-9dff-020fa7178f5e {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-307068414',display_name='tempest-TestVolumeBootPattern-server-307068414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-307068414',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfogU6kYPcp7NAmuZGDid0UKyqw1IdjLF3ZnJERaUBDZkL+xPoChg6A1IGhqjD7zf4jVDGbb4+dyNskSlHAeBsABrlV8tujEJoboi7nPt7TAeLT6Bss/BpxghYXarJuXw==',key_name='tempest-TestVolumeBootPattern-247749559',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:11:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-wsfyte9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:11:51Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=4172a681-fc80-4941-9dff-020fa7178f5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "084667a1-7d39-4699-bffd-fe3e2657d588", "address": "fa:16:3e:ff:45:e0", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084667a1-7d", "ovs_interfaceid": "084667a1-7d39-4699-bffd-fe3e2657d588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "084667a1-7d39-4699-bffd-fe3e2657d588", "address": "fa:16:3e:ff:45:e0", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084667a1-7d", "ovs_interfaceid": "084667a1-7d39-4699-bffd-fe3e2657d588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:45:e0,bridge_name='br-int',has_traffic_filtering=True,id=084667a1-7d39-4699-bffd-fe3e2657d588,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084667a1-7d') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_vif [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:45:e0,bridge_name='br-int',has_traffic_filtering=True,id=084667a1-7d39-4699-bffd-fe3e2657d588,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084667a1-7d') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap084667a1-7d, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6399e443-9189-4036-ac3d-b51008915d11) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:13:34 user nova-compute[75469]: INFO os_vif [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:45:e0,bridge_name='br-int',has_traffic_filtering=True,id=084667a1-7d39-4699-bffd-fe3e2657d588,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084667a1-7d')
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXvSyWTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:13:34 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df6fe22-4057-410e-8aef-48da9068e5e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:13:34 user nova-compute[75469]: No targets found.
Nov 14 05:13:34 user nova-compute[75469]: iSNS:
Nov 14 05:13:34 user nova-compute[75469]: No targets found.
Nov 14 05:13:34 user nova-compute[75469]: STATIC:
Nov 14 05:13:34 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf
Nov 14 05:13:34 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:13:34 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:13:34 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249
Nov 14 05:13:34 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:13:34 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:13:34 user nova-compute[75469]: FIRMWARE:
Nov 14 05:13:34 user nova-compute[75469]: No targets found.
Nov 14 05:13:34 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:13:34 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:13:34 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2600454a-e6b0-410a-a0e0-0e38a75f200d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b53c7c-a457-4694-8c06-7d67ec161540]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:13:34 user nova-compute[75469]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:34 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:13:34 user nova-compute[75469]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:34 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f903a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf'): ({'sdc'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Removing single pathed devices sdc {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[848df96c-8850-4043-91d3-6c1e4c847224]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e669d6-2544-432a-bcf8-7b0233b1f81b]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flushing IO for device /dev/sdc {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4949ac82-d4c6-4676-928d-447789422d5d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0143a267-1330-4b4f-bc3a-1ac84023d990]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] SCSI volumes sdc have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_dc68cae6', '/dev/disk/by-id/scsi-26562333936646631', '/dev/disk/by-id/scsi-1SCST_BIOdc68cae6-eb396df137416135') {{(pid=85531) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c304291-79b4-450e-81ce-22c540d52428]: (4, None) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e370d47d-d39e-4e00-9415-cf580bb3468f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3a9d1e-205c-4b14-b331-45c0f9c9678e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260]
Nov 14 05:13:34 user nova-compute[75469]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260] successful.
Nov 14 05:13:34 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[108ca985-2b08-4e1b-82b2-33cc9b9bb497]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== disconnect_volume: return (370ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:13:34 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:13:34 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Deleting instance files /opt/stack/data/nova/instances/4172a681-fc80-4941-9dff-020fa7178f5e_del
Nov 14 05:13:34 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Deletion of /opt/stack/data/nova/instances/4172a681-fc80-4941-9dff-020fa7178f5e_del complete
Nov 14 05:13:35 user nova-compute[75469]: INFO nova.compute.manager [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 05:13:35 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:13:35 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:13:35 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:13:35 user nova-compute[75469]: DEBUG nova.network.neutron [req-91acd8ec-567f-48cd-965c-28dc9e34020d req-b90c6298-e0f0-464c-a62d-071d296c04c6 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updated VIF entry in instance network info cache for port 37573211-71cc-4684-8d46-5ed2ee9ffae7. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:13:35 user nova-compute[75469]: DEBUG nova.network.neutron [req-91acd8ec-567f-48cd-965c-28dc9e34020d req-b90c6298-e0f0-464c-a62d-071d296c04c6 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updating instance_info_cache with network_info: [{"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:13:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-91acd8ec-567f-48cd-965c-28dc9e34020d req-b90c6298-e0f0-464c-a62d-071d296c04c6 service nova] Releasing lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:13:35 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:13:35 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Took 0.75 seconds to deallocate network for instance.
Nov 14 05:13:35 user nova-compute[75469]: DEBUG nova.compute.manager [req-9a60da8b-a516-4309-b86b-2a3878767e72 req-c3c354a2-0304-4b1e-bfcd-801e9757325a service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Received event network-vif-deleted-084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-2a32881c-3714-4784-9429-3f91bb008a4b req-e122b7a8-5d62-4e07-84aa-501288407698 service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Received event network-vif-plugged-084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2a32881c-3714-4784-9429-3f91bb008a4b req-e122b7a8-5d62-4e07-84aa-501288407698 service nova] Acquiring lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2a32881c-3714-4784-9429-3f91bb008a4b req-e122b7a8-5d62-4e07-84aa-501288407698 service nova] Lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2a32881c-3714-4784-9429-3f91bb008a4b req-e122b7a8-5d62-4e07-84aa-501288407698 service nova] Lock "4172a681-fc80-4941-9dff-020fa7178f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-2a32881c-3714-4784-9429-3f91bb008a4b req-e122b7a8-5d62-4e07-84aa-501288407698 service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] No waiting events found dispatching network-vif-plugged-084667a1-7d39-4699-bffd-fe3e2657d588 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:13:36 user nova-compute[75469]: WARNING nova.compute.manager [req-2a32881c-3714-4784-9429-3f91bb008a4b req-e122b7a8-5d62-4e07-84aa-501288407698 service nova] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Received unexpected event network-vif-plugged-084667a1-7d39-4699-bffd-fe3e2657d588 for instance with vm_state active and task_state deleting.
Nov 14 05:13:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-b6c1023b-a2ac-4227-927e-a51533530ca0 req-6a08bc0c-7919-410a-adff-fa1eaa3200f6 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-changed-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG nova.compute.manager [req-b6c1023b-a2ac-4227-927e-a51533530ca0 req-6a08bc0c-7919-410a-adff-fa1eaa3200f6 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Refreshing instance network info cache due to event network-changed-37573211-71cc-4684-8d46-5ed2ee9ffae7. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b6c1023b-a2ac-4227-927e-a51533530ca0 req-6a08bc0c-7919-410a-adff-fa1eaa3200f6 service nova] Acquiring lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b6c1023b-a2ac-4227-927e-a51533530ca0 req-6a08bc0c-7919-410a-adff-fa1eaa3200f6 service nova] Acquired lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG nova.network.neutron [req-b6c1023b-a2ac-4227-927e-a51533530ca0 req-6a08bc0c-7919-410a-adff-fa1eaa3200f6 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Refreshing network info cache for port 37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:13:36 user nova-compute[75469]: INFO nova.compute.manager [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 4172a681-fc80-4941-9dff-020fa7178f5e] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 05:13:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:36 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Deleted allocations for instance 4172a681-fc80-4941-9dff-020fa7178f5e
Nov 14 05:13:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG nova.network.neutron [req-b6c1023b-a2ac-4227-927e-a51533530ca0 req-6a08bc0c-7919-410a-adff-fa1eaa3200f6 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updated VIF entry in instance network info cache for port 37573211-71cc-4684-8d46-5ed2ee9ffae7. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG nova.network.neutron [req-b6c1023b-a2ac-4227-927e-a51533530ca0 req-6a08bc0c-7919-410a-adff-fa1eaa3200f6 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updating instance_info_cache with network_info: [{"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b6c1023b-a2ac-4227-927e-a51533530ca0 req-6a08bc0c-7919-410a-adff-fa1eaa3200f6 service nova] Releasing lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:13:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f22e363e-f8b8-4836-a8c4-9331e31b2aa3 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "4172a681-fc80-4941-9dff-020fa7178f5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.135s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:38 user nova-compute[75469]: INFO nova.compute.manager [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Rebooting instance
Nov 14 05:13:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:13:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquired lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:13:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:13:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updating instance_info_cache with network_info: [{"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:13:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Releasing lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:13:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-ea70aaf5-b3d1-47e7-bd76-a60b7ae82e35 req-ded3749a-6a76-4265-93d5-539d9c69d83c service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-vif-unplugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ea70aaf5-b3d1-47e7-bd76-a60b7ae82e35 req-ded3749a-6a76-4265-93d5-539d9c69d83c service nova] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ea70aaf5-b3d1-47e7-bd76-a60b7ae82e35 req-ded3749a-6a76-4265-93d5-539d9c69d83c service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ea70aaf5-b3d1-47e7-bd76-a60b7ae82e35 req-ded3749a-6a76-4265-93d5-539d9c69d83c service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-ea70aaf5-b3d1-47e7-bd76-a60b7ae82e35 req-ded3749a-6a76-4265-93d5-539d9c69d83c service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] No waiting events found dispatching network-vif-unplugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:13:39 user nova-compute[75469]: WARNING nova.compute.manager [req-ea70aaf5-b3d1-47e7-bd76-a60b7ae82e35 req-ded3749a-6a76-4265-93d5-539d9c69d83c service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received unexpected event network-vif-unplugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Instance destroyed successfully.
Nov 14 05:13:39 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'resources' on Instance uuid 67ad2387-630f-4066-b1eb-5c915b16232f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754582521',display_name='tempest-TestMinimumBasicScenario-server-754582521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754582521',id=41,image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdn1x0SKdYYLCaB5aogNfyXlQllNVgU2V9rN6tlqiyZC6vNZwxiijQz42jIjTuGsw+EMMki730cHdn1TpeLr4rHn54ZYliYxshD7hA5TC5owk6EoWBzILFVaSibpTEvrw==',key_name='tempest-TestMinimumBasicScenario-1213478591',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:11:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0d0f57326454312bee742d698e94a3b',ramdisk_id='',reservation_id='r-wbj1wlwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1786662085',owner_user_name='tempest-TestMinimumBasicScenario-1786662085-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:13:39Z,user_data=None,user_id='7864a212cd5548f6a8b3d07a3e4a2d58',uuid=67ad2387-630f-4066-b1eb-5c915b16232f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converting VIF {"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_vif [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37573211-71, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bf77beb-e2c9-41c7-b4ee-0f132512bb33) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:39 user nova-compute[75469]: INFO os_vif [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71')
Nov 14 05:13:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKoHIpeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:13:39 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.053s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8a3e1d-9fba-42e5-9b98-c2f2154fe129]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:13:39 user nova-compute[75469]: No targets found.
Nov 14 05:13:39 user nova-compute[75469]: iSNS:
Nov 14 05:13:39 user nova-compute[75469]: No targets found.
Nov 14 05:13:39 user nova-compute[75469]: STATIC:
Nov 14 05:13:39 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249
Nov 14 05:13:39 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:13:39 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:13:39 user nova-compute[75469]: FIRMWARE:
Nov 14 05:13:39 user nova-compute[75469]: No targets found.
Nov 14 05:13:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:13:39 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:13:39 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91fa360-c9af-47ed-90b5-6376f6738e65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32df7af-9f4b-4fd1-99ba-c32a503e6913]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:39 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708ec3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2170a6f8-3864-466b-aa72-3401c5579eb4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dbd15a-dff9-4339-9eda-504f8c3a3717]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f660011-5a6b-4954-b6d9-c3d944f526c2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:13:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6759e3b4-b406-431f-bb2d-e3eb960c0666]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[18568354-4e84-4d3b-8386-355cbe3f63f2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6175ecf5-9c5f-456d-9020-d121617fa282]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260]
Nov 14 05:13:40 user nova-compute[75469]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260] successful.
Nov 14 05:13:40 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c684ffa-90c1-4243-89e5-f4cdd6d8129a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] <== disconnect_volume: return (309ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Start _get_guest_xml network_info=[{"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fd65ed82-e150-4a4e-a620-4b8e761d1930,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'fd65ed82-e150-4a4e-a620-4b8e761d1930'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'ba99adaf-e909-4822-af57-05895f337377', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKoHIpeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '67ad2387-630f-4066-b1eb-5c915b16232f', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8102898-86af-4719-8b93-53819d13d249', 'serial': 'b8102898-86af-4719-8b93-53819d13d249'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:13:40 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:13:40 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fd65ed82-e150-4a4e-a620-4b8e761d1930,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'vcpu_model' on Instance uuid 67ad2387-630f-4066-b1eb-5c915b16232f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.objects.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Object Instance<67ad2387-630f-4066-b1eb-5c915b16232f> lazy-loaded attributes: resources,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKoHIpeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:13:40 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:13:40 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:13:40 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f26a222-80e1-4a14-ba07-382efdcc1b96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:13:40 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dbd0b0-1ce3-4aa9-8161-5900a62ee4d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249] added
Nov 14 05:13:40 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f429e66-4da9-4dcc-9e95-c1e6b42cb70e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8289adfb-bb0a-480c-96a1-5622d445d495]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKoHIpeR {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKoHIpeR" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8737ec-8815-4b03-b695-e9beacdaec52]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iKoHIpeR'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7585ed4-d18d-4658-bcdd-d1045f3372e7]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6348f5bf-2ee5-421d-b971-493252dfea08]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:13:40 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:13:40 user nova-compute[75469]:  {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:13:40 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 05:13:40 user nova-compute[75469]: 
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5163f4d4-cc1d-472e-9c41-e6195f279acf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260]
Nov 14 05:13:40 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260] successful.
Nov 14 05:13:40 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a791a75f-c206-45fc-93a6-001f19ef101d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8c550e-2397-4d32-81ad-55b570bfd662]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:40 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:40 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9c635f-de90-4b60-a3f8-58b9bc912d68]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:13:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKoHIpeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-aeea9ae4-76b9-480f-a1fb-aacc3d5b13b6 req-45bc40ca-db2f-4b57-875b-910af3744871 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aeea9ae4-76b9-480f-a1fb-aacc3d5b13b6 req-45bc40ca-db2f-4b57-875b-910af3744871 service nova] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aeea9ae4-76b9-480f-a1fb-aacc3d5b13b6 req-45bc40ca-db2f-4b57-875b-910af3744871 service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aeea9ae4-76b9-480f-a1fb-aacc3d5b13b6 req-45bc40ca-db2f-4b57-875b-910af3744871 service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.compute.manager [req-aeea9ae4-76b9-480f-a1fb-aacc3d5b13b6 req-45bc40ca-db2f-4b57-875b-910af3744871 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] No waiting events found dispatching network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:13:41 user nova-compute[75469]: WARNING nova.compute.manager [req-aeea9ae4-76b9-480f-a1fb-aacc3d5b13b6 req-45bc40ca-db2f-4b57-875b-910af3744871 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received unexpected event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 05:13:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] <== connect_volume: return (1265ms) {'type': 'block', 'scsi_wwn': '23261393339396639', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261393339396639', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754582521',display_name='tempest-TestMinimumBasicScenario-server-754582521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754582521',id=41,image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdn1x0SKdYYLCaB5aogNfyXlQllNVgU2V9rN6tlqiyZC6vNZwxiijQz42jIjTuGsw+EMMki730cHdn1TpeLr4rHn54ZYliYxshD7hA5TC5owk6EoWBzILFVaSibpTEvrw==',key_name='tempest-TestMinimumBasicScenario-1213478591',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:11:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0d0f57326454312bee742d698e94a3b',ramdisk_id='',reservation_id='r-wbj1wlwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1786662085',owner_user_name='tempest-TestMinimumBasicScenario-1786662085-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:13:39Z,user_data=None,user_id='7864a212cd5548f6a8b3d07a3e4a2d58',uuid=67ad2387-630f-4066-b1eb-5c915b16232f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converting VIF {"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'pci_devices' on Instance uuid 67ad2387-630f-4066-b1eb-5c915b16232f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.objects.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Object Instance<67ad2387-630f-4066-b1eb-5c915b16232f> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:13:41 user nova-compute[75469]:   <uuid>67ad2387-630f-4066-b1eb-5c915b16232f</uuid>
Nov 14 05:13:41 user nova-compute[75469]:   <name>instance-00000029</name>
Nov 14 05:13:41 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:13:41 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:13:41 user nova-compute[75469]:   <metadata>
Nov 14 05:13:41 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:13:41 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:13:41 user nova-compute[75469]:       <nova:name>tempest-TestMinimumBasicScenario-server-754582521</nova:name>
Nov 14 05:13:41 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:13:40</nova:creationTime>
Nov 14 05:13:41 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:13:41 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:13:41 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:13:41 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:13:41 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:13:41 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:13:41 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:13:41 user nova-compute[75469]:       <nova:owner>
Nov 14 05:13:41 user nova-compute[75469]:         <nova:user uuid="7864a212cd5548f6a8b3d07a3e4a2d58">tempest-TestMinimumBasicScenario-1786662085-project-member</nova:user>
Nov 14 05:13:41 user nova-compute[75469]:         <nova:project uuid="d0d0f57326454312bee742d698e94a3b">tempest-TestMinimumBasicScenario-1786662085</nova:project>
Nov 14 05:13:41 user nova-compute[75469]:       </nova:owner>
Nov 14 05:13:41 user nova-compute[75469]:       <nova:root type="image" uuid="fd65ed82-e150-4a4e-a620-4b8e761d1930"/>
Nov 14 05:13:41 user nova-compute[75469]:       <nova:ports>
Nov 14 05:13:41 user nova-compute[75469]:         <nova:port uuid="37573211-71cc-4684-8d46-5ed2ee9ffae7">
Nov 14 05:13:41 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 05:13:41 user nova-compute[75469]:         </nova:port>
Nov 14 05:13:41 user nova-compute[75469]:       </nova:ports>
Nov 14 05:13:41 user nova-compute[75469]:     </nova:instance>
Nov 14 05:13:41 user nova-compute[75469]:   </metadata>
Nov 14 05:13:41 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:13:41 user nova-compute[75469]:     <system>
Nov 14 05:13:41 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:13:41 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:13:41 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:13:41 user nova-compute[75469]:       <entry name="serial">67ad2387-630f-4066-b1eb-5c915b16232f</entry>
Nov 14 05:13:41 user nova-compute[75469]:       <entry name="uuid">67ad2387-630f-4066-b1eb-5c915b16232f</entry>
Nov 14 05:13:41 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:13:41 user nova-compute[75469]:     </system>
Nov 14 05:13:41 user nova-compute[75469]:   </sysinfo>
Nov 14 05:13:41 user nova-compute[75469]:   <os>
Nov 14 05:13:41 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:13:41 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:13:41 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:13:41 user nova-compute[75469]:   </os>
Nov 14 05:13:41 user nova-compute[75469]:   <features>
Nov 14 05:13:41 user nova-compute[75469]:     <acpi/>
Nov 14 05:13:41 user nova-compute[75469]:     <apic/>
Nov 14 05:13:41 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:13:41 user nova-compute[75469]:   </features>
Nov 14 05:13:41 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:13:41 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:13:41 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:13:41 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:13:41 user nova-compute[75469]:   </clock>
Nov 14 05:13:41 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:13:41 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:13:41 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:13:41 user nova-compute[75469]:   </cpu>
Nov 14 05:13:41 user nova-compute[75469]:   <devices>
Nov 14 05:13:41 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:13:41 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:13:41 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk"/>
Nov 14 05:13:41 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:13:41 user nova-compute[75469]:     </disk>
Nov 14 05:13:41 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:13:41 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:13:41 user nova-compute[75469]:       <source dev="/dev/sdb"/>
Nov 14 05:13:41 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 05:13:41 user nova-compute[75469]:       <serial>b8102898-86af-4719-8b93-53819d13d249</serial>
Nov 14 05:13:41 user nova-compute[75469]:     </disk>
Nov 14 05:13:41 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:13:41 user nova-compute[75469]:       <mac address="fa:16:3e:9a:ba:f5"/>
Nov 14 05:13:41 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:13:41 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:13:41 user nova-compute[75469]:       <target dev="tap37573211-71"/>
Nov 14 05:13:41 user nova-compute[75469]:     </interface>
Nov 14 05:13:41 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:13:41 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/console.log" append="off"/>
Nov 14 05:13:41 user nova-compute[75469]:     </serial>
Nov 14 05:13:41 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:13:41 user nova-compute[75469]:     <video>
Nov 14 05:13:41 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:13:41 user nova-compute[75469]:     </video>
Nov 14 05:13:41 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:13:41 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:13:41 user nova-compute[75469]:     </rng>
Nov 14 05:13:41 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:13:41 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:13:41 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:13:41 user nova-compute[75469]:     </memballoon>
Nov 14 05:13:41 user nova-compute[75469]:   </devices>
Nov 14 05:13:41 user nova-compute[75469]: </domain>
Nov 14 05:13:41 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'trusted_certs' on Instance uuid 67ad2387-630f-4066-b1eb-5c915b16232f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG nova.objects.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Object Instance<67ad2387-630f-4066-b1eb-5c915b16232f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:13:41 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Cannot resize image /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'migration_context' on Instance uuid 67ad2387-630f-4066-b1eb-5c915b16232f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG nova.objects.base [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Object Instance<67ad2387-630f-4066-b1eb-5c915b16232f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754582521',display_name='tempest-TestMinimumBasicScenario-server-754582521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754582521',id=41,image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdn1x0SKdYYLCaB5aogNfyXlQllNVgU2V9rN6tlqiyZC6vNZwxiijQz42jIjTuGsw+EMMki730cHdn1TpeLr4rHn54ZYliYxshD7hA5TC5owk6EoWBzILFVaSibpTEvrw==',key_name='tempest-TestMinimumBasicScenario-1213478591',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:11:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d0d0f57326454312bee742d698e94a3b',ramdisk_id='',reservation_id='r-wbj1wlwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1786662085',owner_user_name='tempest-TestMinimumBasicScenario-1786662085-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:13:39Z,user_data=None,user_id='7864a212cd5548f6a8b3d07a3e4a2d58',uuid=67ad2387-630f-4066-b1eb-5c915b16232f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converting VIF {"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG os_vif [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c0351c2-171c-54ab-b257-96108793a167', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37573211-71, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37573211-71, col_values=(('qos', UUID('e6c18ab0-0736-4339-b8de-0889a88f20d4')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37573211-71, col_values=(('external_ids', {'iface-id': '37573211-71cc-4684-8d46-5ed2ee9ffae7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:ba:f5', 'vm-uuid': '67ad2387-630f-4066-b1eb-5c915b16232f'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:13:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:42 user nova-compute[75469]: INFO os_vif [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71')
Nov 14 05:13:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:43 user nova-compute[75469]: DEBUG nova.compute.manager [req-ddbca6e3-0ed3-403d-9359-57c84358325e req-f0e23720-7a14-48e5-84ed-003b346ed8c1 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ddbca6e3-0ed3-403d-9359-57c84358325e req-f0e23720-7a14-48e5-84ed-003b346ed8c1 service nova] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ddbca6e3-0ed3-403d-9359-57c84358325e req-f0e23720-7a14-48e5-84ed-003b346ed8c1 service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ddbca6e3-0ed3-403d-9359-57c84358325e req-f0e23720-7a14-48e5-84ed-003b346ed8c1 service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:43 user nova-compute[75469]: DEBUG nova.compute.manager [req-ddbca6e3-0ed3-403d-9359-57c84358325e req-f0e23720-7a14-48e5-84ed-003b346ed8c1 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] No waiting events found dispatching network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:13:43 user nova-compute[75469]: WARNING nova.compute.manager [req-ddbca6e3-0ed3-403d-9359-57c84358325e req-f0e23720-7a14-48e5-84ed-003b346ed8c1 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received unexpected event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 05:13:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:13:45 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Instance rebooted successfully.
Nov 14 05:13:45 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:13:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-2695a9db-4a3d-4026-a1d9-50ea99cebadb req-5ffde164-77e5-42e0-aaab-84280e89abd8 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2695a9db-4a3d-4026-a1d9-50ea99cebadb req-5ffde164-77e5-42e0-aaab-84280e89abd8 service nova] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2695a9db-4a3d-4026-a1d9-50ea99cebadb req-5ffde164-77e5-42e0-aaab-84280e89abd8 service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2695a9db-4a3d-4026-a1d9-50ea99cebadb req-5ffde164-77e5-42e0-aaab-84280e89abd8 service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:45 user nova-compute[75469]: DEBUG nova.compute.manager [req-2695a9db-4a3d-4026-a1d9-50ea99cebadb req-5ffde164-77e5-42e0-aaab-84280e89abd8 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] No waiting events found dispatching network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:13:45 user nova-compute[75469]: WARNING nova.compute.manager [req-2695a9db-4a3d-4026-a1d9-50ea99cebadb req-5ffde164-77e5-42e0-aaab-84280e89abd8 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received unexpected event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 05:13:45 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ac4874ca-6df1-42c1-9e77-0664ec062741 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.454s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:13:51 user nova-compute[75469]: INFO nova.compute.claims [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Claim successful on node user
Nov 14 05:13:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG nova.network.neutron [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:13:51 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:13:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:13:51 user nova-compute[75469]: INFO nova.virt.block_device [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Booting with volume cd156c13-96fa-495d-bdf2-0961539d0d89 at /dev/vda
Nov 14 05:13:51 user nova-compute[75469]: DEBUG nova.policy [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fedd54c65b8a4adbba761994474cdd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac925f78df5d4746a9bd603db3613839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG os_brick.utils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8c4ddb-6c4c-4b61-9719-e87f25c4d3f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ddda4f-1cbc-481d-be2e-227b81f1556f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab957722-88bf-4f66-a356-c5139bd5ac66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[70996a2a-c2ad-4ff4-bfe0-bc88ab998eca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:13:51 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:13:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[814360ec-4136-41bf-9668-94260ad65abf]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG os_brick.utils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:13:51 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating existing volume attachment record: ce66ea2a-6e0b-449c-b9cf-cc35df42aa0b {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:13:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:52 user nova-compute[75469]: DEBUG nova.network.neutron [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Successfully created port: 8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG nova.network.neutron [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Successfully updated port: 8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquired lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG nova.network.neutron [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-140509ee-228f-450b-8396-63c05cddc1f0 req-3639b314-ff71-4527-a8a0-1c71ccb3398a service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-changed-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG nova.compute.manager [req-140509ee-228f-450b-8396-63c05cddc1f0 req-3639b314-ff71-4527-a8a0-1c71ccb3398a service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Refreshing instance network info cache due to event network-changed-8db52a6a-b924-4207-8734-fb45e4091992. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-140509ee-228f-450b-8396-63c05cddc1f0 req-3639b314-ff71-4527-a8a0-1c71ccb3398a service nova] Acquiring lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG nova.network.neutron [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG nova.network.neutron [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating instance_info_cache with network_info: [{"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Releasing lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Instance network_info: |[{"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-140509ee-228f-450b-8396-63c05cddc1f0 req-3639b314-ff71-4527-a8a0-1c71ccb3398a service nova] Acquired lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:13:53 user nova-compute[75469]: DEBUG nova.network.neutron [req-140509ee-228f-450b-8396-63c05cddc1f0 req-3639b314-ff71-4527-a8a0-1c71ccb3398a service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Refreshing network info cache for port 8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:13:54 user nova-compute[75469]: DEBUG nova.network.neutron [req-140509ee-228f-450b-8396-63c05cddc1f0 req-3639b314-ff71-4527-a8a0-1c71ccb3398a service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updated VIF entry in instance network info cache for port 8db52a6a-b924-4207-8734-fb45e4091992. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:13:54 user nova-compute[75469]: DEBUG nova.network.neutron [req-140509ee-228f-450b-8396-63c05cddc1f0 req-3639b314-ff71-4527-a8a0-1c71ccb3398a service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating instance_info_cache with network_info: [{"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:13:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-140509ee-228f-450b-8396-63c05cddc1f0 req-3639b314-ff71-4527-a8a0-1c71ccb3398a service nova] Releasing lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:13:56 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Creating image(s)
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Ensure instance console log exists: /opt/stack/data/nova/instances/a3c26481-d6c3-4480-b145-8e4d06db929a/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Start _get_guest_xml network_info=[{"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'ce66ea2a-6e0b-449c-b9cf-cc35df42aa0b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ovfypgdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3c26481-d6c3-4480-b145-8e4d06db929a', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd156c13-96fa-495d-bdf2-0961539d0d89', 'serial': 'cd156c13-96fa-495d-bdf2-0961539d0d89'}, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:13:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:13:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ovfypgdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:13:56 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:13:56 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:13:56 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5035c100-45d3-4051-a41e-1e7b0f16d53b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:13:56 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37ff68b-9c3f-4c33-9260-0d04a195d4b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89] added
Nov 14 05:13:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfd340e-769e-4f55-9dcc-dae4300e2fb9]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a29859-1e07-415a-8c25-ca269c7f9ec6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ovfypgdn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ovfypgdn" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d046f605-10a1-4f20-a8a5-7318e95425b0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Ovfypgdn'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d4756a-4922-4e7d-be9a-1d96be942ca7]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a43453b-b32a-4744-bed0-ff205372d9a2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf2c79-0e2c-40b5-89d8-b8cb1e351fb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260]
Nov 14 05:13:56 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260] successful.
Nov 14 05:13:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe624dc-8fa2-4952-a70c-c5d7fac30bad]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6efaf4-921e-4a68-b526-80556beb1530]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:56 user nova-compute[75469]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:13:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:13:56 user nova-compute[75469]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:13:56 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc10cbaa-a420-41e7-81fa-aa0663440f98]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:13:56 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ovfypgdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23931613935626332', 'path': '/dev/sdc'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931613935626332', 'path': '/dev/sdc'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1514638986',display_name='tempest-ServerActionsTestOtherA-server-1514638986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1514638986',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrNma5JBatAznC0LunFsDc00r1VsCTPs0bqBhYBSNLvVRScOCFUVl5vvCUAjsb33gm8T0M5HMwN7cuhFNaAaCpsdN1cxvRi8VbjuP9vzYk0bdC0OKE726Gcl41/vQzpiA==',key_name='tempest-keypair-438915203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-0897f8e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a3c26481-d6c3-4480-b145-8e4d06db929a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG nova.objects.instance [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'pci_devices' on Instance uuid a3c26481-d6c3-4480-b145-8e4d06db929a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:13:57 user nova-compute[75469]:   <uuid>a3c26481-d6c3-4480-b145-8e4d06db929a</uuid>
Nov 14 05:13:57 user nova-compute[75469]:   <name>instance-0000002c</name>
Nov 14 05:13:57 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:13:57 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:13:57 user nova-compute[75469]:   <metadata>
Nov 14 05:13:57 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:13:57 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:13:57 user nova-compute[75469]:       <nova:name>tempest-ServerActionsTestOtherA-server-1514638986</nova:name>
Nov 14 05:13:57 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:13:56</nova:creationTime>
Nov 14 05:13:57 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:13:57 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:13:57 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:13:57 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:13:57 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:13:57 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:13:57 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:13:57 user nova-compute[75469]:       <nova:owner>
Nov 14 05:13:57 user nova-compute[75469]:         <nova:user uuid="fedd54c65b8a4adbba761994474cdd9b">tempest-ServerActionsTestOtherA-2099137527-project-member</nova:user>
Nov 14 05:13:57 user nova-compute[75469]:         <nova:project uuid="ac925f78df5d4746a9bd603db3613839">tempest-ServerActionsTestOtherA-2099137527</nova:project>
Nov 14 05:13:57 user nova-compute[75469]:       </nova:owner>
Nov 14 05:13:57 user nova-compute[75469]:       <nova:ports>
Nov 14 05:13:57 user nova-compute[75469]:         <nova:port uuid="8db52a6a-b924-4207-8734-fb45e4091992">
Nov 14 05:13:57 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 05:13:57 user nova-compute[75469]:         </nova:port>
Nov 14 05:13:57 user nova-compute[75469]:       </nova:ports>
Nov 14 05:13:57 user nova-compute[75469]:     </nova:instance>
Nov 14 05:13:57 user nova-compute[75469]:   </metadata>
Nov 14 05:13:57 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:13:57 user nova-compute[75469]:     <system>
Nov 14 05:13:57 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:13:57 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:13:57 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:13:57 user nova-compute[75469]:       <entry name="serial">a3c26481-d6c3-4480-b145-8e4d06db929a</entry>
Nov 14 05:13:57 user nova-compute[75469]:       <entry name="uuid">a3c26481-d6c3-4480-b145-8e4d06db929a</entry>
Nov 14 05:13:57 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:13:57 user nova-compute[75469]:     </system>
Nov 14 05:13:57 user nova-compute[75469]:   </sysinfo>
Nov 14 05:13:57 user nova-compute[75469]:   <os>
Nov 14 05:13:57 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:13:57 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:13:57 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:13:57 user nova-compute[75469]:   </os>
Nov 14 05:13:57 user nova-compute[75469]:   <features>
Nov 14 05:13:57 user nova-compute[75469]:     <acpi/>
Nov 14 05:13:57 user nova-compute[75469]:     <apic/>
Nov 14 05:13:57 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:13:57 user nova-compute[75469]:   </features>
Nov 14 05:13:57 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:13:57 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:13:57 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:13:57 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:13:57 user nova-compute[75469]:   </clock>
Nov 14 05:13:57 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:13:57 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:13:57 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:13:57 user nova-compute[75469]:   </cpu>
Nov 14 05:13:57 user nova-compute[75469]:   <devices>
Nov 14 05:13:57 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:13:57 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:13:57 user nova-compute[75469]:       <source dev="/dev/sdc"/>
Nov 14 05:13:57 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:13:57 user nova-compute[75469]:       <serial>cd156c13-96fa-495d-bdf2-0961539d0d89</serial>
Nov 14 05:13:57 user nova-compute[75469]:     </disk>
Nov 14 05:13:57 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:13:57 user nova-compute[75469]:       <mac address="fa:16:3e:da:90:e0"/>
Nov 14 05:13:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:13:57 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:13:57 user nova-compute[75469]:       <target dev="tap8db52a6a-b9"/>
Nov 14 05:13:57 user nova-compute[75469]:     </interface>
Nov 14 05:13:57 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:13:57 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/a3c26481-d6c3-4480-b145-8e4d06db929a/console.log" append="off"/>
Nov 14 05:13:57 user nova-compute[75469]:     </serial>
Nov 14 05:13:57 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:13:57 user nova-compute[75469]:     <video>
Nov 14 05:13:57 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:13:57 user nova-compute[75469]:     </video>
Nov 14 05:13:57 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:13:57 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:13:57 user nova-compute[75469]:     </rng>
Nov 14 05:13:57 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:13:57 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:13:57 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:13:57 user nova-compute[75469]:     </memballoon>
Nov 14 05:13:57 user nova-compute[75469]:   </devices>
Nov 14 05:13:57 user nova-compute[75469]: </domain>
Nov 14 05:13:57 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1514638986',display_name='tempest-ServerActionsTestOtherA-server-1514638986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1514638986',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrNma5JBatAznC0LunFsDc00r1VsCTPs0bqBhYBSNLvVRScOCFUVl5vvCUAjsb33gm8T0M5HMwN7cuhFNaAaCpsdN1cxvRi8VbjuP9vzYk0bdC0OKE726Gcl41/vQzpiA==',key_name='tempest-keypair-438915203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-0897f8e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a3c26481-d6c3-4480-b145-8e4d06db929a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG os_vif [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '314a1b3f-49a6-5cce-ba05-aa9094c38350', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:13:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8db52a6a-b9, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8db52a6a-b9, col_values=(('qos', UUID('c8589289-5373-489f-aa1c-f931dc814054')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8db52a6a-b9, col_values=(('external_ids', {'iface-id': '8db52a6a-b924-4207-8734-fb45e4091992', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:90:e0', 'vm-uuid': 'a3c26481-d6c3-4480-b145-8e4d06db929a'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:13:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:13:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:58 user nova-compute[75469]: INFO os_vif [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9')
Nov 14 05:13:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:13:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No VIF found with MAC fa:16:3e:da:90:e0, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Skipping network cache update for instance because it is Building. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid d742ff9e-3b9f-4d3f-9825-3d3361765b24 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-2af8cbbf-f04c-4740-8897-e5282781c212 req-f426187b-984e-4b97-ba99-dc6fac4fd9aa service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2af8cbbf-f04c-4740-8897-e5282781c212 req-f426187b-984e-4b97-ba99-dc6fac4fd9aa service nova] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2af8cbbf-f04c-4740-8897-e5282781c212 req-f426187b-984e-4b97-ba99-dc6fac4fd9aa service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2af8cbbf-f04c-4740-8897-e5282781c212 req-f426187b-984e-4b97-ba99-dc6fac4fd9aa service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG nova.compute.manager [req-2af8cbbf-f04c-4740-8897-e5282781c212 req-f426187b-984e-4b97-ba99-dc6fac4fd9aa service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] No waiting events found dispatching network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:13:59 user nova-compute[75469]: WARNING nova.compute.manager [req-2af8cbbf-f04c-4740-8897-e5282781c212 req-f426187b-984e-4b97-ba99-dc6fac4fd9aa service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received unexpected event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 for instance with vm_state building and task_state spawning.
Nov 14 05:13:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:13:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updating instance_info_cache with network_info: [{"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:14:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-2b7e8340-4a7c-416c-8fbd-fc712e494a3b req-0d5f0991-01ae-4030-9e5f-9c5ae0ae1f39 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2b7e8340-4a7c-416c-8fbd-fc712e494a3b req-0d5f0991-01ae-4030-9e5f-9c5ae0ae1f39 service nova] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2b7e8340-4a7c-416c-8fbd-fc712e494a3b req-0d5f0991-01ae-4030-9e5f-9c5ae0ae1f39 service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2b7e8340-4a7c-416c-8fbd-fc712e494a3b req-0d5f0991-01ae-4030-9e5f-9c5ae0ae1f39 service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.manager [req-2b7e8340-4a7c-416c-8fbd-fc712e494a3b req-0d5f0991-01ae-4030-9e5f-9c5ae0ae1f39 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] No waiting events found dispatching network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:14:02 user nova-compute[75469]: WARNING nova.compute.manager [req-2b7e8340-4a7c-416c-8fbd-fc712e494a3b req-0d5f0991-01ae-4030-9e5f-9c5ae0ae1f39 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received unexpected event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 for instance with vm_state building and task_state spawning.
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:14:02 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Instance spawned successfully.
Nov 14 05:14:02 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:14:02 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8492MB free_disk=24.914505004882812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:02 user nova-compute[75469]: INFO nova.compute.manager [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 67ad2387-630f-4066-b1eb-5c915b16232f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c4a6a311-e640-471c-9b63-39d3a32a2796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a3c26481-d6c3-4480-b145-8e4d06db929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:14:02 user nova-compute[75469]: INFO nova.compute.manager [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Took 11.24 seconds to build instance.
Nov 14 05:14:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7960f53d-ba6e-4468-b031-bbb7ea85dcf7 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.340s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:14:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:03 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:14:03 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:14:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:14:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:14:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:14:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:14:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:08 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:14:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:14:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:14:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "25fe6319-9929-4c0a-8c47-71ac31624899" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "25fe6319-9929-4c0a-8c47-71ac31624899" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:14:17 user nova-compute[75469]: INFO nova.compute.claims [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Claim successful on node user
Nov 14 05:14:17 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:14:17 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:14:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG nova.policy [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c8bacf3e4d54f8fb27f84f87c693e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fc8e6026a4487b9288b15dee67072f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:14:17 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Creating image(s)
Nov 14 05:14:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "/opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "/opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "/opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk 1073741824" returned: 0 in 0.049s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Successfully created port: 70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Cannot resize image /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Ensure instance console log exists: /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Successfully updated port: 70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "refresh_cache-25fe6319-9929-4c0a-8c47-71ac31624899" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquired lock "refresh_cache-25fe6319-9929-4c0a-8c47-71ac31624899" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-120b563c-d4b8-4697-b1c0-e2be8fcf446c req-4242e6b4-c5f5-4000-8cf9-405791dd137b service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Received event network-changed-70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-120b563c-d4b8-4697-b1c0-e2be8fcf446c req-4242e6b4-c5f5-4000-8cf9-405791dd137b service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Refreshing instance network info cache due to event network-changed-70d12591-0849-4beb-b761-945c63fc737e. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:14:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-120b563c-d4b8-4697-b1c0-e2be8fcf446c req-4242e6b4-c5f5-4000-8cf9-405791dd137b service nova] Acquiring lock "refresh_cache-25fe6319-9929-4c0a-8c47-71ac31624899" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Updating instance_info_cache with network_info: [{"id": "70d12591-0849-4beb-b761-945c63fc737e", "address": "fa:16:3e:e5:56:d9", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d12591-08", "ovs_interfaceid": "70d12591-0849-4beb-b761-945c63fc737e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Releasing lock "refresh_cache-25fe6319-9929-4c0a-8c47-71ac31624899" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Instance network_info: |[{"id": "70d12591-0849-4beb-b761-945c63fc737e", "address": "fa:16:3e:e5:56:d9", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d12591-08", "ovs_interfaceid": "70d12591-0849-4beb-b761-945c63fc737e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-120b563c-d4b8-4697-b1c0-e2be8fcf446c req-4242e6b4-c5f5-4000-8cf9-405791dd137b service nova] Acquired lock "refresh_cache-25fe6319-9929-4c0a-8c47-71ac31624899" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-120b563c-d4b8-4697-b1c0-e2be8fcf446c req-4242e6b4-c5f5-4000-8cf9-405791dd137b service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Refreshing network info cache for port 70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Start _get_guest_xml network_info=[{"id": "70d12591-0849-4beb-b761-945c63fc737e", "address": "fa:16:3e:e5:56:d9", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d12591-08", "ovs_interfaceid": "70d12591-0849-4beb-b761-945c63fc737e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:14:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:14:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2050754636',display_name='tempest-ServersNegativeTestJSON-server-2050754636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2050754636',id=45,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39fc8e6026a4487b9288b15dee67072f',ramdisk_id='',reservation_id='r-3nkywyxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1402505206',owner_user_name='tempest-ServersNegativeTestJSON-1402505206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:14:18Z,user_data=None,user_id='7c8bacf3e4d54f8fb27f84f87c693e11',uuid=25fe6319-9929-4c0a-8c47-71ac31624899,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d12591-0849-4beb-b761-945c63fc737e", "address": "fa:16:3e:e5:56:d9", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d12591-08", "ovs_interfaceid": "70d12591-0849-4beb-b761-945c63fc737e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converting VIF {"id": "70d12591-0849-4beb-b761-945c63fc737e", "address": "fa:16:3e:e5:56:d9", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d12591-08", "ovs_interfaceid": "70d12591-0849-4beb-b761-945c63fc737e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:56:d9,bridge_name='br-int',has_traffic_filtering=True,id=70d12591-0849-4beb-b761-945c63fc737e,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d12591-08') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.objects.instance [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lazy-loading 'pci_devices' on Instance uuid 25fe6319-9929-4c0a-8c47-71ac31624899 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:14:19 user nova-compute[75469]:   <uuid>25fe6319-9929-4c0a-8c47-71ac31624899</uuid>
Nov 14 05:14:19 user nova-compute[75469]:   <name>instance-0000002d</name>
Nov 14 05:14:19 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:14:19 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:14:19 user nova-compute[75469]:   <metadata>
Nov 14 05:14:19 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:14:19 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:14:19 user nova-compute[75469]:       <nova:name>tempest-ServersNegativeTestJSON-server-2050754636</nova:name>
Nov 14 05:14:19 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:14:19</nova:creationTime>
Nov 14 05:14:19 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:14:19 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:14:19 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:14:19 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:14:19 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:14:19 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:14:19 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:14:19 user nova-compute[75469]:       <nova:owner>
Nov 14 05:14:19 user nova-compute[75469]:         <nova:user uuid="7c8bacf3e4d54f8fb27f84f87c693e11">tempest-ServersNegativeTestJSON-1402505206-project-member</nova:user>
Nov 14 05:14:19 user nova-compute[75469]:         <nova:project uuid="39fc8e6026a4487b9288b15dee67072f">tempest-ServersNegativeTestJSON-1402505206</nova:project>
Nov 14 05:14:19 user nova-compute[75469]:       </nova:owner>
Nov 14 05:14:19 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:14:19 user nova-compute[75469]:       <nova:ports>
Nov 14 05:14:19 user nova-compute[75469]:         <nova:port uuid="70d12591-0849-4beb-b761-945c63fc737e">
Nov 14 05:14:19 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 05:14:19 user nova-compute[75469]:         </nova:port>
Nov 14 05:14:19 user nova-compute[75469]:       </nova:ports>
Nov 14 05:14:19 user nova-compute[75469]:     </nova:instance>
Nov 14 05:14:19 user nova-compute[75469]:   </metadata>
Nov 14 05:14:19 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:14:19 user nova-compute[75469]:     <system>
Nov 14 05:14:19 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:14:19 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:14:19 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:14:19 user nova-compute[75469]:       <entry name="serial">25fe6319-9929-4c0a-8c47-71ac31624899</entry>
Nov 14 05:14:19 user nova-compute[75469]:       <entry name="uuid">25fe6319-9929-4c0a-8c47-71ac31624899</entry>
Nov 14 05:14:19 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:14:19 user nova-compute[75469]:     </system>
Nov 14 05:14:19 user nova-compute[75469]:   </sysinfo>
Nov 14 05:14:19 user nova-compute[75469]:   <os>
Nov 14 05:14:19 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:14:19 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:14:19 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:14:19 user nova-compute[75469]:   </os>
Nov 14 05:14:19 user nova-compute[75469]:   <features>
Nov 14 05:14:19 user nova-compute[75469]:     <acpi/>
Nov 14 05:14:19 user nova-compute[75469]:     <apic/>
Nov 14 05:14:19 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:14:19 user nova-compute[75469]:   </features>
Nov 14 05:14:19 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:14:19 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:14:19 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:14:19 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:14:19 user nova-compute[75469]:   </clock>
Nov 14 05:14:19 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:14:19 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:14:19 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:14:19 user nova-compute[75469]:   </cpu>
Nov 14 05:14:19 user nova-compute[75469]:   <devices>
Nov 14 05:14:19 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:14:19 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:14:19 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk"/>
Nov 14 05:14:19 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:14:19 user nova-compute[75469]:     </disk>
Nov 14 05:14:19 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:14:19 user nova-compute[75469]:       <mac address="fa:16:3e:e5:56:d9"/>
Nov 14 05:14:19 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:14:19 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:14:19 user nova-compute[75469]:       <target dev="tap70d12591-08"/>
Nov 14 05:14:19 user nova-compute[75469]:     </interface>
Nov 14 05:14:19 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:14:19 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/console.log" append="off"/>
Nov 14 05:14:19 user nova-compute[75469]:     </serial>
Nov 14 05:14:19 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:14:19 user nova-compute[75469]:     <video>
Nov 14 05:14:19 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:14:19 user nova-compute[75469]:     </video>
Nov 14 05:14:19 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:14:19 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:14:19 user nova-compute[75469]:     </rng>
Nov 14 05:14:19 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:14:19 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:14:19 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:14:19 user nova-compute[75469]:     </memballoon>
Nov 14 05:14:19 user nova-compute[75469]:   </devices>
Nov 14 05:14:19 user nova-compute[75469]: </domain>
Nov 14 05:14:19 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2050754636',display_name='tempest-ServersNegativeTestJSON-server-2050754636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2050754636',id=45,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39fc8e6026a4487b9288b15dee67072f',ramdisk_id='',reservation_id='r-3nkywyxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1402505206',owner_user_name='tempest-ServersNegativeTestJSON-1402505206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:14:18Z,user_data=None,user_id='7c8bacf3e4d54f8fb27f84f87c693e11',uuid=25fe6319-9929-4c0a-8c47-71ac31624899,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d12591-0849-4beb-b761-945c63fc737e", "address": "fa:16:3e:e5:56:d9", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d12591-08", "ovs_interfaceid": "70d12591-0849-4beb-b761-945c63fc737e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converting VIF {"id": "70d12591-0849-4beb-b761-945c63fc737e", "address": "fa:16:3e:e5:56:d9", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d12591-08", "ovs_interfaceid": "70d12591-0849-4beb-b761-945c63fc737e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:56:d9,bridge_name='br-int',has_traffic_filtering=True,id=70d12591-0849-4beb-b761-945c63fc737e,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d12591-08') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG os_vif [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:56:d9,bridge_name='br-int',has_traffic_filtering=True,id=70d12591-0849-4beb-b761-945c63fc737e,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d12591-08') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67f77a61-da42-551c-86f1-16cec103f5b6', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70d12591-08, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70d12591-08, col_values=(('qos', UUID('15c280b4-950d-4119-aa59-945fd6e3e648')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70d12591-08, col_values=(('external_ids', {'iface-id': '70d12591-0849-4beb-b761-945c63fc737e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:56:d9', 'vm-uuid': '25fe6319-9929-4c0a-8c47-71ac31624899'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:19 user nova-compute[75469]: INFO os_vif [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:56:d9,bridge_name='br-int',has_traffic_filtering=True,id=70d12591-0849-4beb-b761-945c63fc737e,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d12591-08')
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] No VIF found with MAC fa:16:3e:e5:56:d9, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-120b563c-d4b8-4697-b1c0-e2be8fcf446c req-4242e6b4-c5f5-4000-8cf9-405791dd137b service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Updated VIF entry in instance network info cache for port 70d12591-0849-4beb-b761-945c63fc737e. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-120b563c-d4b8-4697-b1c0-e2be8fcf446c req-4242e6b4-c5f5-4000-8cf9-405791dd137b service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Updating instance_info_cache with network_info: [{"id": "70d12591-0849-4beb-b761-945c63fc737e", "address": "fa:16:3e:e5:56:d9", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d12591-08", "ovs_interfaceid": "70d12591-0849-4beb-b761-945c63fc737e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:14:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-120b563c-d4b8-4697-b1c0-e2be8fcf446c req-4242e6b4-c5f5-4000-8cf9-405791dd137b service nova] Releasing lock "refresh_cache-25fe6319-9929-4c0a-8c47-71ac31624899" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:14:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-e68841a0-24ef-4dac-b159-5e5febd38303 req-199f927d-3463-4693-921a-75993ae098ff service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Received event network-vif-plugged-70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:14:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e68841a0-24ef-4dac-b159-5e5febd38303 req-199f927d-3463-4693-921a-75993ae098ff service nova] Acquiring lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e68841a0-24ef-4dac-b159-5e5febd38303 req-199f927d-3463-4693-921a-75993ae098ff service nova] Lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e68841a0-24ef-4dac-b159-5e5febd38303 req-199f927d-3463-4693-921a-75993ae098ff service nova] Lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-e68841a0-24ef-4dac-b159-5e5febd38303 req-199f927d-3463-4693-921a-75993ae098ff service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] No waiting events found dispatching network-vif-plugged-70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:14:20 user nova-compute[75469]: WARNING nova.compute.manager [req-e68841a0-24ef-4dac-b159-5e5febd38303 req-199f927d-3463-4693-921a-75993ae098ff service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Received unexpected event network-vif-plugged-70d12591-0849-4beb-b761-945c63fc737e for instance with vm_state building and task_state spawning.
Nov 14 05:14:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-3e4f18b6-81f3-41ec-9e4e-3e5f4abbfa50 req-05e4b9b0-f57c-4751-8bd9-89a26cc06178 service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Received event network-vif-plugged-70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:14:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3e4f18b6-81f3-41ec-9e4e-3e5f4abbfa50 req-05e4b9b0-f57c-4751-8bd9-89a26cc06178 service nova] Acquiring lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3e4f18b6-81f3-41ec-9e4e-3e5f4abbfa50 req-05e4b9b0-f57c-4751-8bd9-89a26cc06178 service nova] Lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3e4f18b6-81f3-41ec-9e4e-3e5f4abbfa50 req-05e4b9b0-f57c-4751-8bd9-89a26cc06178 service nova] Lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-3e4f18b6-81f3-41ec-9e4e-3e5f4abbfa50 req-05e4b9b0-f57c-4751-8bd9-89a26cc06178 service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] No waiting events found dispatching network-vif-plugged-70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:14:22 user nova-compute[75469]: WARNING nova.compute.manager [req-3e4f18b6-81f3-41ec-9e4e-3e5f4abbfa50 req-05e4b9b0-f57c-4751-8bd9-89a26cc06178 service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Received unexpected event network-vif-plugged-70d12591-0849-4beb-b761-945c63fc737e for instance with vm_state building and task_state spawning.
Nov 14 05:14:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:14:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:14:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Instance spawned successfully.
Nov 14 05:14:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:14:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:23 user nova-compute[75469]: INFO nova.compute.manager [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 14 05:14:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:14:23 user nova-compute[75469]: INFO nova.compute.manager [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Took 5.77 seconds to build instance.
Nov 14 05:14:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6f21056d-b22d-4ea2-a3c8-5e1dd399429b tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "25fe6319-9929-4c0a-8c47-71ac31624899" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.871s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "22604611-34b5-40fa-8bda-86ddd0e0eb37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:25 user nova-compute[75469]: DEBUG nova.compute.manager [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:14:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:25 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:14:25 user nova-compute[75469]: INFO nova.compute.claims [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Claim successful on node user
Nov 14 05:14:25 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:14:25 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:14:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:14:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG nova.policy [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0155ca3745514d6c8c0ab08a9182df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf022cc839af44ff89e4249410c4a9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:14:26 user nova-compute[75469]: INFO nova.virt.block_device [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Booting with volume abafa81b-179e-47ae-a014-5a2c909c21cf at /dev/vda
Nov 14 05:14:26 user nova-compute[75469]: DEBUG os_brick.utils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1809d915-dcae-49b7-85c4-6a5980488333]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef954727-c427-4cad-8173-1a52a7fabf70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78e4778-766c-4472-8dea-65b9aaccdd6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[57749f49-6695-4c14-97a3-038e4f7aef75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:14:26 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:14:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea45cf65-23c0-4816-b56c-77348fad7860]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG os_brick.utils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Updating existing volume attachment record: 49dbfc6c-14a3-49f8-8887-f9dedc82aafe {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Successfully created port: 889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:14:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Successfully updated port: 889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquired lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-aca94e11-09cc-45e8-8c18-ef0faed79abc req-51ec809d-3fda-4f3e-89ba-53cfc15f1f91 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received event network-changed-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-aca94e11-09cc-45e8-8c18-ef0faed79abc req-51ec809d-3fda-4f3e-89ba-53cfc15f1f91 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Refreshing instance network info cache due to event network-changed-889c8c86-6ec3-40a1-8761-92721c773e2a. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aca94e11-09cc-45e8-8c18-ef0faed79abc req-51ec809d-3fda-4f3e-89ba-53cfc15f1f91 service nova] Acquiring lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Updating instance_info_cache with network_info: [{"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Releasing lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Instance network_info: |[{"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aca94e11-09cc-45e8-8c18-ef0faed79abc req-51ec809d-3fda-4f3e-89ba-53cfc15f1f91 service nova] Acquired lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:14:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-aca94e11-09cc-45e8-8c18-ef0faed79abc req-51ec809d-3fda-4f3e-89ba-53cfc15f1f91 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Refreshing network info cache for port 889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:14:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-aca94e11-09cc-45e8-8c18-ef0faed79abc req-51ec809d-3fda-4f3e-89ba-53cfc15f1f91 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Updated VIF entry in instance network info cache for port 889c8c86-6ec3-40a1-8761-92721c773e2a. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:14:28 user nova-compute[75469]: DEBUG nova.network.neutron [req-aca94e11-09cc-45e8-8c18-ef0faed79abc req-51ec809d-3fda-4f3e-89ba-53cfc15f1f91 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Updating instance_info_cache with network_info: [{"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:14:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aca94e11-09cc-45e8-8c18-ef0faed79abc req-51ec809d-3fda-4f3e-89ba-53cfc15f1f91 service nova] Releasing lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:14:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:14:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Creating image(s)
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Ensure instance console log exists: /opt/stack/data/nova/instances/22604611-34b5-40fa-8bda-86ddd0e0eb37/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Start _get_guest_xml network_info=[{"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '49dbfc6c-14a3-49f8-8887-f9dedc82aafe', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXvSyWTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '22604611-34b5-40fa-8bda-86ddd0e0eb37', 'attached_at': '', 'detached_at': '', 'volume_id': 'abafa81b-179e-47ae-a014-5a2c909c21cf', 'serial': 'abafa81b-179e-47ae-a014-5a2c909c21cf'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:14:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:14:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXvSyWTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:14:30 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:14:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:14:30 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:14:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:14:30 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4692a8b6-5b2c-4755-886e-340bf9f62743]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:14:30 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5757a457-2ac3-47a1-a6c8-e54a40f82f82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf] added
Nov 14 05:14:30 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[37adbd4c-6bbc-4383-9ef6-cfd6ad7ab4d3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f85152c-35ef-4f4f-9d49-836628364098]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:14:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXvSyWTf {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXvSyWTf" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ce4874-4cbe-4e7f-a12d-741d136d78cf]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pXvSyWTf'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[04627958-328b-4020-b51d-47103d62aa01]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e0ff27-2008-4f30-a355-9f935be19de3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:14:31 user nova-compute[75469]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:14:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:14:31 user nova-compute[75469]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:14:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a62fd3d-a209-4d74-89e1-0f59689e43a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260]
Nov 14 05:14:31 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260] successful.
Nov 14 05:14:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[886fb5bf-0c62-449c-82f4-08e7462b03ce]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19e292f-b90c-44e7-be00-1fbb6bb95f56]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:14:31 user nova-compute[75469]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:14:31 user nova-compute[75469]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:14:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:14:31 user nova-compute[75469]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:14:31 user nova-compute[75469]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:14:31 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc15a0a-6ac0-4a51-a758-394c5c33596a]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXvSyWTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:14:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26562333936646631', 'path': '/dev/sdd'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562333936646631', 'path': '/dev/sdd'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-295756470',display_name='tempest-TestVolumeBootPattern-server-295756470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-295756470',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfogU6kYPcp7NAmuZGDid0UKyqw1IdjLF3ZnJERaUBDZkL+xPoChg6A1IGhqjD7zf4jVDGbb4+dyNskSlHAeBsABrlV8tujEJoboi7nPt7TAeLT6Bss/BpxghYXarJuXw==',key_name='tempest-TestVolumeBootPattern-247749559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-5fvkz1l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:14:26Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=22604611-34b5-40fa-8bda-86ddd0e0eb37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:40:03,bridge_name='br-int',has_traffic_filtering=True,id=889c8c86-6ec3-40a1-8761-92721c773e2a,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889c8c86-6e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG nova.objects.instance [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'pci_devices' on Instance uuid 22604611-34b5-40fa-8bda-86ddd0e0eb37 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:14:32 user nova-compute[75469]:   <uuid>22604611-34b5-40fa-8bda-86ddd0e0eb37</uuid>
Nov 14 05:14:32 user nova-compute[75469]:   <name>instance-0000002e</name>
Nov 14 05:14:32 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:14:32 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:14:32 user nova-compute[75469]:   <metadata>
Nov 14 05:14:32 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:14:32 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:14:32 user nova-compute[75469]:       <nova:name>tempest-TestVolumeBootPattern-server-295756470</nova:name>
Nov 14 05:14:32 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:14:30</nova:creationTime>
Nov 14 05:14:32 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:14:32 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:14:32 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:14:32 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:14:32 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:14:32 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:14:32 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:14:32 user nova-compute[75469]:       <nova:owner>
Nov 14 05:14:32 user nova-compute[75469]:         <nova:user uuid="0155ca3745514d6c8c0ab08a9182df53">tempest-TestVolumeBootPattern-43343925-project-member</nova:user>
Nov 14 05:14:32 user nova-compute[75469]:         <nova:project uuid="bf022cc839af44ff89e4249410c4a9e4">tempest-TestVolumeBootPattern-43343925</nova:project>
Nov 14 05:14:32 user nova-compute[75469]:       </nova:owner>
Nov 14 05:14:32 user nova-compute[75469]:       <nova:ports>
Nov 14 05:14:32 user nova-compute[75469]:         <nova:port uuid="889c8c86-6ec3-40a1-8761-92721c773e2a">
Nov 14 05:14:32 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 05:14:32 user nova-compute[75469]:         </nova:port>
Nov 14 05:14:32 user nova-compute[75469]:       </nova:ports>
Nov 14 05:14:32 user nova-compute[75469]:     </nova:instance>
Nov 14 05:14:32 user nova-compute[75469]:   </metadata>
Nov 14 05:14:32 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:14:32 user nova-compute[75469]:     <system>
Nov 14 05:14:32 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:14:32 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:14:32 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:14:32 user nova-compute[75469]:       <entry name="serial">22604611-34b5-40fa-8bda-86ddd0e0eb37</entry>
Nov 14 05:14:32 user nova-compute[75469]:       <entry name="uuid">22604611-34b5-40fa-8bda-86ddd0e0eb37</entry>
Nov 14 05:14:32 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:14:32 user nova-compute[75469]:     </system>
Nov 14 05:14:32 user nova-compute[75469]:   </sysinfo>
Nov 14 05:14:32 user nova-compute[75469]:   <os>
Nov 14 05:14:32 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:14:32 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:14:32 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:14:32 user nova-compute[75469]:   </os>
Nov 14 05:14:32 user nova-compute[75469]:   <features>
Nov 14 05:14:32 user nova-compute[75469]:     <acpi/>
Nov 14 05:14:32 user nova-compute[75469]:     <apic/>
Nov 14 05:14:32 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:14:32 user nova-compute[75469]:   </features>
Nov 14 05:14:32 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:14:32 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:14:32 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:14:32 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:14:32 user nova-compute[75469]:   </clock>
Nov 14 05:14:32 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:14:32 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:14:32 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:14:32 user nova-compute[75469]:   </cpu>
Nov 14 05:14:32 user nova-compute[75469]:   <devices>
Nov 14 05:14:32 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:14:32 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:14:32 user nova-compute[75469]:       <source dev="/dev/sdd"/>
Nov 14 05:14:32 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:14:32 user nova-compute[75469]:       <serial>abafa81b-179e-47ae-a014-5a2c909c21cf</serial>
Nov 14 05:14:32 user nova-compute[75469]:     </disk>
Nov 14 05:14:32 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:14:32 user nova-compute[75469]:       <mac address="fa:16:3e:8b:40:03"/>
Nov 14 05:14:32 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:14:32 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:14:32 user nova-compute[75469]:       <target dev="tap889c8c86-6e"/>
Nov 14 05:14:32 user nova-compute[75469]:     </interface>
Nov 14 05:14:32 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:14:32 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/22604611-34b5-40fa-8bda-86ddd0e0eb37/console.log" append="off"/>
Nov 14 05:14:32 user nova-compute[75469]:     </serial>
Nov 14 05:14:32 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:14:32 user nova-compute[75469]:     <video>
Nov 14 05:14:32 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:14:32 user nova-compute[75469]:     </video>
Nov 14 05:14:32 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:14:32 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:14:32 user nova-compute[75469]:     </rng>
Nov 14 05:14:32 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:14:32 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:14:32 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:14:32 user nova-compute[75469]:     </memballoon>
Nov 14 05:14:32 user nova-compute[75469]:   </devices>
Nov 14 05:14:32 user nova-compute[75469]: </domain>
Nov 14 05:14:32 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-295756470',display_name='tempest-TestVolumeBootPattern-server-295756470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-295756470',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfogU6kYPcp7NAmuZGDid0UKyqw1IdjLF3ZnJERaUBDZkL+xPoChg6A1IGhqjD7zf4jVDGbb4+dyNskSlHAeBsABrlV8tujEJoboi7nPt7TAeLT6Bss/BpxghYXarJuXw==',key_name='tempest-TestVolumeBootPattern-247749559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-5fvkz1l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:14:26Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=22604611-34b5-40fa-8bda-86ddd0e0eb37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:40:03,bridge_name='br-int',has_traffic_filtering=True,id=889c8c86-6ec3-40a1-8761-92721c773e2a,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889c8c86-6e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG os_vif [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:40:03,bridge_name='br-int',has_traffic_filtering=True,id=889c8c86-6ec3-40a1-8761-92721c773e2a,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889c8c86-6e') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb009c0e-e797-5732-90ce-889fa9e897f1', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap889c8c86-6e, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap889c8c86-6e, col_values=(('qos', UUID('8f5405c7-f458-4cc1-9361-09065289e318')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap889c8c86-6e, col_values=(('external_ids', {'iface-id': '889c8c86-6ec3-40a1-8761-92721c773e2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:40:03', 'vm-uuid': '22604611-34b5-40fa-8bda-86ddd0e0eb37'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:32 user nova-compute[75469]: INFO os_vif [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:40:03,bridge_name='br-int',has_traffic_filtering=True,id=889c8c86-6ec3-40a1-8761-92721c773e2a,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889c8c86-6e')
Nov 14 05:14:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:14:32 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No VIF found with MAC fa:16:3e:8b:40:03, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:14:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:33 user nova-compute[75469]: DEBUG nova.compute.manager [req-dfb79ccf-b5da-476b-9ddf-01349f696471 req-785d8123-2b20-4819-8a7e-735190e84d86 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received event network-vif-plugged-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:14:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dfb79ccf-b5da-476b-9ddf-01349f696471 req-785d8123-2b20-4819-8a7e-735190e84d86 service nova] Acquiring lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dfb79ccf-b5da-476b-9ddf-01349f696471 req-785d8123-2b20-4819-8a7e-735190e84d86 service nova] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dfb79ccf-b5da-476b-9ddf-01349f696471 req-785d8123-2b20-4819-8a7e-735190e84d86 service nova] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:33 user nova-compute[75469]: DEBUG nova.compute.manager [req-dfb79ccf-b5da-476b-9ddf-01349f696471 req-785d8123-2b20-4819-8a7e-735190e84d86 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] No waiting events found dispatching network-vif-plugged-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:14:33 user nova-compute[75469]: WARNING nova.compute.manager [req-dfb79ccf-b5da-476b-9ddf-01349f696471 req-785d8123-2b20-4819-8a7e-735190e84d86 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received unexpected event network-vif-plugged-889c8c86-6ec3-40a1-8761-92721c773e2a for instance with vm_state building and task_state spawning.
Nov 14 05:14:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.compute.manager [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:14:35 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Instance spawned successfully.
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:14:35 user nova-compute[75469]: INFO nova.compute.manager [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.compute.manager [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.compute.manager [req-1c132c42-ca20-41a1-aa3f-e2f981a831b0 req-43f64a72-1cf9-4be9-a299-474528716aa1 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received event network-vif-plugged-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1c132c42-ca20-41a1-aa3f-e2f981a831b0 req-43f64a72-1cf9-4be9-a299-474528716aa1 service nova] Acquiring lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1c132c42-ca20-41a1-aa3f-e2f981a831b0 req-43f64a72-1cf9-4be9-a299-474528716aa1 service nova] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1c132c42-ca20-41a1-aa3f-e2f981a831b0 req-43f64a72-1cf9-4be9-a299-474528716aa1 service nova] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:35 user nova-compute[75469]: DEBUG nova.compute.manager [req-1c132c42-ca20-41a1-aa3f-e2f981a831b0 req-43f64a72-1cf9-4be9-a299-474528716aa1 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] No waiting events found dispatching network-vif-plugged-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:14:35 user nova-compute[75469]: WARNING nova.compute.manager [req-1c132c42-ca20-41a1-aa3f-e2f981a831b0 req-43f64a72-1cf9-4be9-a299-474528716aa1 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received unexpected event network-vif-plugged-889c8c86-6ec3-40a1-8761-92721c773e2a for instance with vm_state building and task_state spawning.
Nov 14 05:14:35 user nova-compute[75469]: INFO nova.compute.manager [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Took 10.18 seconds to build instance.
Nov 14 05:14:35 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-685fbc43-108e-49f1-a5cf-cb4c5ec654ab tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.276s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:14:59 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:15:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:15:01 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:15:01 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8198MB free_disk=24.88302993774414GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 67ad2387-630f-4066-b1eb-5c915b16232f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c4a6a311-e640-471c-9b63-39d3a32a2796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a3c26481-d6c3-4480-b145-8e4d06db929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 25fe6319-9929-4c0a-8c47-71ac31624899 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 22604611-34b5-40fa-8bda-86ddd0e0eb37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:15:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:02 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:15:02 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:15:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:15:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:15:02 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:15:02 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updating instance_info_cache with network_info: [{"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:15:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:15:02 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:15:03 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:15:03 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:15:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:15:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:15:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:15:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:15:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:15:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:15:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:15:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:15:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:15:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:15:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:15:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:15:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:15:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:15:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:15:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-cb1b3462-5942-4c25-be30-59395969ce17 req-ce33aa4e-6d91-459c-936a-61f453b6e844 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-changed-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-cb1b3462-5942-4c25-be30-59395969ce17 req-ce33aa4e-6d91-459c-936a-61f453b6e844 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Refreshing instance network info cache due to event network-changed-37573211-71cc-4684-8d46-5ed2ee9ffae7. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cb1b3462-5942-4c25-be30-59395969ce17 req-ce33aa4e-6d91-459c-936a-61f453b6e844 service nova] Acquiring lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cb1b3462-5942-4c25-be30-59395969ce17 req-ce33aa4e-6d91-459c-936a-61f453b6e844 service nova] Acquired lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG nova.network.neutron [req-cb1b3462-5942-4c25-be30-59395969ce17 req-ce33aa4e-6d91-459c-936a-61f453b6e844 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Refreshing network info cache for port 37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-f345a4e6-05fb-4f30-a992-0ac37a3fae64 req-640b3865-6272-4e3c-ac72-de82e2ffbaad service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-changed-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG nova.compute.manager [req-f345a4e6-05fb-4f30-a992-0ac37a3fae64 req-640b3865-6272-4e3c-ac72-de82e2ffbaad service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Refreshing instance network info cache due to event network-changed-37573211-71cc-4684-8d46-5ed2ee9ffae7. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f345a4e6-05fb-4f30-a992-0ac37a3fae64 req-640b3865-6272-4e3c-ac72-de82e2ffbaad service nova] Acquiring lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG nova.network.neutron [req-cb1b3462-5942-4c25-be30-59395969ce17 req-ce33aa4e-6d91-459c-936a-61f453b6e844 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updated VIF entry in instance network info cache for port 37573211-71cc-4684-8d46-5ed2ee9ffae7. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG nova.network.neutron [req-cb1b3462-5942-4c25-be30-59395969ce17 req-ce33aa4e-6d91-459c-936a-61f453b6e844 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updating instance_info_cache with network_info: [{"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cb1b3462-5942-4c25-be30-59395969ce17 req-ce33aa4e-6d91-459c-936a-61f453b6e844 service nova] Releasing lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f345a4e6-05fb-4f30-a992-0ac37a3fae64 req-640b3865-6272-4e3c-ac72-de82e2ffbaad service nova] Acquired lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:15:30 user nova-compute[75469]: DEBUG nova.network.neutron [req-f345a4e6-05fb-4f30-a992-0ac37a3fae64 req-640b3865-6272-4e3c-ac72-de82e2ffbaad service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Refreshing network info cache for port 37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:15:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:15:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:15:31 user nova-compute[75469]: INFO nova.compute.manager [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Detaching volume b8102898-86af-4719-8b93-53819d13d249
Nov 14 05:15:31 user nova-compute[75469]: INFO nova.virt.block_device [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Attempting to driver detach volume b8102898-86af-4719-8b93-53819d13d249 from mountpoint /dev/vdb
Nov 14 05:15:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Attempting to detach device vdb from instance 67ad2387-630f-4066-b1eb-5c915b16232f from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:15:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:15:31 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:15:31 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:15:31 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:15:31 user nova-compute[75469]:   <serial>b8102898-86af-4719-8b93-53819d13d249</serial>
Nov 14 05:15:31 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 05:15:31 user nova-compute[75469]: </disk>
Nov 14 05:15:31 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:15:31 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Successfully detached device vdb from instance 67ad2387-630f-4066-b1eb-5c915b16232f from the persistent domain config.
Nov 14 05:15:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67ad2387-630f-4066-b1eb-5c915b16232f from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:15:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:15:31 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:15:31 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:15:31 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:15:31 user nova-compute[75469]:   <serial>b8102898-86af-4719-8b93-53819d13d249</serial>
Nov 14 05:15:31 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 05:15:31 user nova-compute[75469]: </disk>
Nov 14 05:15:31 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:15:31 user nova-compute[75469]: DEBUG nova.network.neutron [req-f345a4e6-05fb-4f30-a992-0ac37a3fae64 req-640b3865-6272-4e3c-ac72-de82e2ffbaad service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updated VIF entry in instance network info cache for port 37573211-71cc-4684-8d46-5ed2ee9ffae7. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:15:31 user nova-compute[75469]: DEBUG nova.network.neutron [req-f345a4e6-05fb-4f30-a992-0ac37a3fae64 req-640b3865-6272-4e3c-ac72-de82e2ffbaad service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updating instance_info_cache with network_info: [{"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:15:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f345a4e6-05fb-4f30-a992-0ac37a3fae64 req-640b3865-6272-4e3c-ac72-de82e2ffbaad service nova] Releasing lock "refresh_cache-67ad2387-630f-4066-b1eb-5c915b16232f" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:15:31 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67ad2387-630f-4066-b1eb-5c915b16232f {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:15:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:15:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:15:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:15:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:15:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:15:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-a62e4765-f369-4c59-8660-9622f29eb960 req-7f47c767-b340-473a-996e-99fca19769ad service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received event network-changed-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:15:42 user nova-compute[75469]: DEBUG nova.compute.manager [req-a62e4765-f369-4c59-8660-9622f29eb960 req-7f47c767-b340-473a-996e-99fca19769ad service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Refreshing instance network info cache due to event network-changed-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:15:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a62e4765-f369-4c59-8660-9622f29eb960 req-7f47c767-b340-473a-996e-99fca19769ad service nova] Acquiring lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:15:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a62e4765-f369-4c59-8660-9622f29eb960 req-7f47c767-b340-473a-996e-99fca19769ad service nova] Acquired lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:15:42 user nova-compute[75469]: DEBUG nova.network.neutron [req-a62e4765-f369-4c59-8660-9622f29eb960 req-7f47c767-b340-473a-996e-99fca19769ad service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Refreshing network info cache for port e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:15:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:42 user nova-compute[75469]: DEBUG nova.network.neutron [req-a62e4765-f369-4c59-8660-9622f29eb960 req-7f47c767-b340-473a-996e-99fca19769ad service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updated VIF entry in instance network info cache for port e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:15:42 user nova-compute[75469]: DEBUG nova.network.neutron [req-a62e4765-f369-4c59-8660-9622f29eb960 req-7f47c767-b340-473a-996e-99fca19769ad service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updating instance_info_cache with network_info: [{"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:15:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a62e4765-f369-4c59-8660-9622f29eb960 req-7f47c767-b340-473a-996e-99fca19769ad service nova] Releasing lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:15:43 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Stashing vm_state: active {{(pid=75469) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 05:15:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:15:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:15:43 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:15:43 user nova-compute[75469]: INFO nova.compute.claims [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Claim successful on node user
Nov 14 05:15:43 user nova-compute[75469]: INFO nova.compute.resource_tracker [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating resource usage from migration cbcd2f9f-8c66-48cb-8b84-747622963de9
Nov 14 05:15:43 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:15:43 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:15:43 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.340s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:15:43 user nova-compute[75469]: INFO nova.compute.manager [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Migrating
Nov 14 05:15:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquired lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-1cfb0ac3-8880-41e7-94db-833b2b05ef34 req-e09940a6-eabc-4cbf-aba4-ff0ddf40d629 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-changed-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-1cfb0ac3-8880-41e7-94db-833b2b05ef34 req-e09940a6-eabc-4cbf-aba4-ff0ddf40d629 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Refreshing instance network info cache due to event network-changed-8db52a6a-b924-4207-8734-fb45e4091992. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1cfb0ac3-8880-41e7-94db-833b2b05ef34 req-e09940a6-eabc-4cbf-aba4-ff0ddf40d629 service nova] Acquiring lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating instance_info_cache with network_info: [{"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Releasing lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1cfb0ac3-8880-41e7-94db-833b2b05ef34 req-e09940a6-eabc-4cbf-aba4-ff0ddf40d629 service nova] Acquired lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG nova.network.neutron [req-1cfb0ac3-8880-41e7-94db-833b2b05ef34 req-e09940a6-eabc-4cbf-aba4-ff0ddf40d629 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Refreshing network info cache for port 8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Starting migrate_disk_and_power_off {{(pid=75469) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-69f7a071-b1b0-47dd-953e-3698b63aa4bf req-24dbffe7-ac24-4b18-9b45-aa88059df29c service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-vif-unplugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-69f7a071-b1b0-47dd-953e-3698b63aa4bf req-24dbffe7-ac24-4b18-9b45-aa88059df29c service nova] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-69f7a071-b1b0-47dd-953e-3698b63aa4bf req-24dbffe7-ac24-4b18-9b45-aa88059df29c service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-69f7a071-b1b0-47dd-953e-3698b63aa4bf req-24dbffe7-ac24-4b18-9b45-aa88059df29c service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-69f7a071-b1b0-47dd-953e-3698b63aa4bf req-24dbffe7-ac24-4b18-9b45-aa88059df29c service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] No waiting events found dispatching network-vif-unplugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:15:44 user nova-compute[75469]: WARNING nova.compute.manager [req-69f7a071-b1b0-47dd-953e-3698b63aa4bf req-24dbffe7-ac24-4b18-9b45-aa88059df29c service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received unexpected event network-vif-unplugged-8db52a6a-b924-4207-8734-fb45e4091992 for instance with vm_state active and task_state resize_migrating.
Nov 14 05:15:44 user nova-compute[75469]: DEBUG nova.network.neutron [req-1cfb0ac3-8880-41e7-94db-833b2b05ef34 req-e09940a6-eabc-4cbf-aba4-ff0ddf40d629 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updated VIF entry in instance network info cache for port 8db52a6a-b924-4207-8734-fb45e4091992. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG nova.network.neutron [req-1cfb0ac3-8880-41e7-94db-833b2b05ef34 req-e09940a6-eabc-4cbf-aba4-ff0ddf40d629 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating instance_info_cache with network_info: [{"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1cfb0ac3-8880-41e7-94db-833b2b05ef34 req-e09940a6-eabc-4cbf-aba4-ff0ddf40d629 service nova] Releasing lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:45 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Instance destroyed successfully.
Nov 14 05:15:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1514638986',display_name='tempest-ServerActionsTestOtherA-server-1514638986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1514638986',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrNma5JBatAznC0LunFsDc00r1VsCTPs0bqBhYBSNLvVRScOCFUVl5vvCUAjsb33gm8T0M5HMwN7cuhFNaAaCpsdN1cxvRi8VbjuP9vzYk0bdC0OKE726Gcl41/vQzpiA==',key_name='tempest-keypair-438915203',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-0897f8e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a3c26481-d6c3-4480-b145-8e4d06db929a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519941654-network", "vif_mac": "fa:16:3e:da:90:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519941654-network", "vif_mac": "fa:16:3e:da:90:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_vif [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8db52a6a-b9, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8589289-5373-489f-aa1c-f931dc814054) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:15:45 user nova-compute[75469]: INFO os_vif [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9')
Nov 14 05:15:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ovfypgdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:15:45 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3f21bb-ee8f-4a57-99aa-88b5c35c598d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:15:45 user nova-compute[75469]: No targets found.
Nov 14 05:15:45 user nova-compute[75469]: iSNS:
Nov 14 05:15:45 user nova-compute[75469]: No targets found.
Nov 14 05:15:45 user nova-compute[75469]: STATIC:
Nov 14 05:15:45 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89
Nov 14 05:15:45 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:15:45 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:15:45 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf
Nov 14 05:15:45 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:15:45 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:15:45 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249
Nov 14 05:15:45 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:15:45 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:15:45 user nova-compute[75469]: FIRMWARE:
Nov 14 05:15:45 user nova-compute[75469]: No targets found.
Nov 14 05:15:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:15:45 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:15:45 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e51d0aa-82af-4e3a-8adc-f93e807acda8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2764923e-c281-4598-96d3-6c505a092a7a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:15:45 user nova-compute[75469]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:15:45 user nova-compute[75469]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:15:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:15:45 user nova-compute[75469]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:15:45 user nova-compute[75469]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:15:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f6ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89'): ({'sdc'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Removing single pathed devices sdc {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97b3522-14b4-4fc1-9091-bed761dfd379]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[81be3772-741e-468b-a13e-57f7dab856f4]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flushing IO for device /dev/sdc {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74c7a6e-d680-499e-9291-f5a8c18f0cbf]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[40649abc-2ffb-4496-a120-4b4c28fc44b2]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] SCSI volumes sdc have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a7be2c4a', '/dev/disk/by-id/scsi-1SCST_BIOa7be2c4a-91a95bc2aba712d0', '/dev/disk/by-id/scsi-23931613935626332') {{(pid=85531) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d62b054-554f-49c7-a7e0-de9924356594]: (4, None) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[604e78a3-34dd-4c36-8167-ecff09241bb2]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9866c8-864d-40ec-9d0b-4f931dc720ee]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260]
Nov 14 05:15:45 user nova-compute[75469]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260] successful.
Nov 14 05:15:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fef794-51a4-404e-be95-044462e12eac]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== disconnect_volume: return (303ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:15:45 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Port 8db52a6a-b924-4207-8734-fb45e4091992 binding to destination host user is already ACTIVE {{(pid=75469) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquired lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-7fae0c73-fb5e-4ebf-987a-9ce152f4f759 req-c85f27e0-1dc2-4d1d-ad7d-ddf70d22a7e3 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7fae0c73-fb5e-4ebf-987a-9ce152f4f759 req-c85f27e0-1dc2-4d1d-ad7d-ddf70d22a7e3 service nova] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7fae0c73-fb5e-4ebf-987a-9ce152f4f759 req-c85f27e0-1dc2-4d1d-ad7d-ddf70d22a7e3 service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7fae0c73-fb5e-4ebf-987a-9ce152f4f759 req-c85f27e0-1dc2-4d1d-ad7d-ddf70d22a7e3 service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:15:46 user nova-compute[75469]: DEBUG nova.compute.manager [req-7fae0c73-fb5e-4ebf-987a-9ce152f4f759 req-c85f27e0-1dc2-4d1d-ad7d-ddf70d22a7e3 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] No waiting events found dispatching network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:15:46 user nova-compute[75469]: WARNING nova.compute.manager [req-7fae0c73-fb5e-4ebf-987a-9ce152f4f759 req-c85f27e0-1dc2-4d1d-ad7d-ddf70d22a7e3 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received unexpected event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 for instance with vm_state active and task_state resize_migrated.
Nov 14 05:15:47 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating instance_info_cache with network_info: [{"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Releasing lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG os_brick.utils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab4debe-2fbb-4d1d-82c4-cfe3eb0396b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[276e4d1b-b9b6-4b60-ae44-a96effcfa313]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[098009c3-a4e2-4e89-9d6a-b9db210065e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb714920-7a57-4baa-8e67-b4d667c9b772]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:15:47 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:15:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ff0281-f414-4c9f-a0c7-4722579671e7]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:15:47 user nova-compute[75469]: DEBUG os_brick.utils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:15:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Starting finish_migration {{(pid=75469) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Instance directory exists: not creating {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 05:15:51 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Creating image(s)
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Ensure instance console log exists: /opt/stack/data/nova/instances/a3c26481-d6c3-4480-b145-8e4d06db929a/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Start _get_guest_xml network_info=[{"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519941654-network", "vif_mac": "fa:16:3e:da:90:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '8cb13f4c-a75f-42ae-a5a8-36d9ba135ea6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ovfypgdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a3c26481-d6c3-4480-b145-8e4d06db929a', 'attached_at': '2023-11-14T05:15:51.000000', 'detached_at': '', 'volume_id': 'cd156c13-96fa-495d-bdf2-0961539d0d89', 'serial': 'cd156c13-96fa-495d-bdf2-0961539d0d89'}, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:15:51 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:15:51 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ovfypgdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:15:51 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:15:51 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:15:51 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[64757333-a84e-4674-b2d9-4a34039de8fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:15:51 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:51 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67ad2387-630f-4066-b1eb-5c915b16232f is timed out.
Nov 14 05:15:51 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Successfully detached device vdb from instance 67ad2387-630f-4066-b1eb-5c915b16232f from the live domain config.
Nov 14 05:15:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKoHIpeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:15:51 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0afff5-f5a3-48bc-a8e4-171d8d522659]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89] added
Nov 14 05:15:51 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4230bf8-f2d5-4e9a-b99d-090e5e961853]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45180d3-2c1d-49ee-9b46-782213d2bfc9]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ovfypgdn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ovfypgdn" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28c953d-a4dc-40a3-8536-f38b7cae0a18]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Ovfypgdn'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f77258-fef6-498a-bce8-5cbb54074e5f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52e0193-06d4-42e6-8405-089d17200caf]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:15:51 user nova-compute[75469]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:15:51 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:15:51 user nova-compute[75469]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:15:51 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[114a1d9b-b562-40e5-9517-1b500fc7ef65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260]
Nov 14 05:15:51 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260] successful.
Nov 14 05:15:51 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a2e424-6fe6-4604-b363-1274aa4c67e1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2783849-ba79-4305-92bc-598e344c311d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:15:51 user nova-compute[75469]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:15:51 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:15:51 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:15:51 user nova-compute[75469]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:15:51 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:15:51 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f241bd26-91d8-47fd-8804-4340d803df86]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:51 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ovfypgdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23931613935626332', 'path': '/dev/sdc'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931613935626332', 'path': '/dev/sdc'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.264s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dec41b-523d-406a-bb53-18e9379b8eab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:15:52 user nova-compute[75469]: No targets found.
Nov 14 05:15:52 user nova-compute[75469]: iSNS:
Nov 14 05:15:52 user nova-compute[75469]: No targets found.
Nov 14 05:15:52 user nova-compute[75469]: STATIC:
Nov 14 05:15:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89
Nov 14 05:15:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:15:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:15:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf
Nov 14 05:15:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:15:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:15:52 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249
Nov 14 05:15:52 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:15:52 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:15:52 user nova-compute[75469]: FIRMWARE:
Nov 14 05:15:52 user nova-compute[75469]: No targets found.
Nov 14 05:15:52 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:15:52 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:15:52 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1514638986',display_name='tempest-ServerActionsTestOtherA-server-1514638986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1514638986',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrNma5JBatAznC0LunFsDc00r1VsCTPs0bqBhYBSNLvVRScOCFUVl5vvCUAjsb33gm8T0M5HMwN7cuhFNaAaCpsdN1cxvRi8VbjuP9vzYk0bdC0OKE726Gcl41/vQzpiA==',key_name='tempest-keypair-438915203',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-0897f8e2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:15:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a3c26481-d6c3-4480-b145-8e4d06db929a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519941654-network", "vif_mac": "fa:16:3e:da:90:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519941654-network", "vif_mac": "fa:16:3e:da:90:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:15:52 user nova-compute[75469]:   <uuid>a3c26481-d6c3-4480-b145-8e4d06db929a</uuid>
Nov 14 05:15:52 user nova-compute[75469]:   <name>instance-0000002c</name>
Nov 14 05:15:52 user nova-compute[75469]:   <memory>2097152</memory>
Nov 14 05:15:52 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:15:52 user nova-compute[75469]:   <metadata>
Nov 14 05:15:52 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:15:52 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:15:52 user nova-compute[75469]:       <nova:name>tempest-ServerActionsTestOtherA-server-1514638986</nova:name>
Nov 14 05:15:52 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:15:51</nova:creationTime>
Nov 14 05:15:52 user nova-compute[75469]:       <nova:flavor name="m1.small">
Nov 14 05:15:52 user nova-compute[75469]:         <nova:memory>2048</nova:memory>
Nov 14 05:15:52 user nova-compute[75469]:         <nova:disk>20</nova:disk>
Nov 14 05:15:52 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:15:52 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:15:52 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:15:52 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:15:52 user nova-compute[75469]:       <nova:owner>
Nov 14 05:15:52 user nova-compute[75469]:         <nova:user uuid="fedd54c65b8a4adbba761994474cdd9b">tempest-ServerActionsTestOtherA-2099137527-project-member</nova:user>
Nov 14 05:15:52 user nova-compute[75469]:         <nova:project uuid="ac925f78df5d4746a9bd603db3613839">tempest-ServerActionsTestOtherA-2099137527</nova:project>
Nov 14 05:15:52 user nova-compute[75469]:       </nova:owner>
Nov 14 05:15:52 user nova-compute[75469]:       <nova:ports>
Nov 14 05:15:52 user nova-compute[75469]:         <nova:port uuid="8db52a6a-b924-4207-8734-fb45e4091992">
Nov 14 05:15:52 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 05:15:52 user nova-compute[75469]:         </nova:port>
Nov 14 05:15:52 user nova-compute[75469]:       </nova:ports>
Nov 14 05:15:52 user nova-compute[75469]:     </nova:instance>
Nov 14 05:15:52 user nova-compute[75469]:   </metadata>
Nov 14 05:15:52 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:15:52 user nova-compute[75469]:     <system>
Nov 14 05:15:52 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:15:52 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:15:52 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:15:52 user nova-compute[75469]:       <entry name="serial">a3c26481-d6c3-4480-b145-8e4d06db929a</entry>
Nov 14 05:15:52 user nova-compute[75469]:       <entry name="uuid">a3c26481-d6c3-4480-b145-8e4d06db929a</entry>
Nov 14 05:15:52 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:15:52 user nova-compute[75469]:     </system>
Nov 14 05:15:52 user nova-compute[75469]:   </sysinfo>
Nov 14 05:15:52 user nova-compute[75469]:   <os>
Nov 14 05:15:52 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:15:52 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:15:52 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:15:52 user nova-compute[75469]:   </os>
Nov 14 05:15:52 user nova-compute[75469]:   <features>
Nov 14 05:15:52 user nova-compute[75469]:     <acpi/>
Nov 14 05:15:52 user nova-compute[75469]:     <apic/>
Nov 14 05:15:52 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:15:52 user nova-compute[75469]:   </features>
Nov 14 05:15:52 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:15:52 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:15:52 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:15:52 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:15:52 user nova-compute[75469]:   </clock>
Nov 14 05:15:52 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:15:52 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:15:52 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:15:52 user nova-compute[75469]:   </cpu>
Nov 14 05:15:52 user nova-compute[75469]:   <devices>
Nov 14 05:15:52 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:15:52 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:15:52 user nova-compute[75469]:       <source dev="/dev/sdc"/>
Nov 14 05:15:52 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:15:52 user nova-compute[75469]:       <serial>cd156c13-96fa-495d-bdf2-0961539d0d89</serial>
Nov 14 05:15:52 user nova-compute[75469]:     </disk>
Nov 14 05:15:52 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:15:52 user nova-compute[75469]:       <mac address="fa:16:3e:da:90:e0"/>
Nov 14 05:15:52 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:15:52 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:15:52 user nova-compute[75469]:       <target dev="tap8db52a6a-b9"/>
Nov 14 05:15:52 user nova-compute[75469]:     </interface>
Nov 14 05:15:52 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:15:52 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/a3c26481-d6c3-4480-b145-8e4d06db929a/console.log" append="off"/>
Nov 14 05:15:52 user nova-compute[75469]:     </serial>
Nov 14 05:15:52 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:15:52 user nova-compute[75469]:     <video>
Nov 14 05:15:52 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:15:52 user nova-compute[75469]:     </video>
Nov 14 05:15:52 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:15:52 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:15:52 user nova-compute[75469]:     </rng>
Nov 14 05:15:52 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:15:52 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:15:52 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:15:52 user nova-compute[75469]:     </memballoon>
Nov 14 05:15:52 user nova-compute[75469]:   </devices>
Nov 14 05:15:52 user nova-compute[75469]: </domain>
Nov 14 05:15:52 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1514638986',display_name='tempest-ServerActionsTestOtherA-server-1514638986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1514638986',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrNma5JBatAznC0LunFsDc00r1VsCTPs0bqBhYBSNLvVRScOCFUVl5vvCUAjsb33gm8T0M5HMwN7cuhFNaAaCpsdN1cxvRi8VbjuP9vzYk0bdC0OKE726Gcl41/vQzpiA==',key_name='tempest-keypair-438915203',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-0897f8e2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:15:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a3c26481-d6c3-4480-b145-8e4d06db929a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519941654-network", "vif_mac": "fa:16:3e:da:90:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519941654-network", "vif_mac": "fa:16:3e:da:90:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_vif [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '314a1b3f-49a6-5cce-ba05-aa9094c38350', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfcb74e-a302-4b73-ac0e-e70eeaec85c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8db52a6a-b9, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8db52a6a-b9, col_values=(('qos', UUID('2319821f-8970-49e0-b810-05f883b02e99')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8db52a6a-b9, col_values=(('external_ids', {'iface-id': '8db52a6a-b924-4207-8734-fb45e4091992', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:90:e0', 'vm-uuid': 'a3c26481-d6c3-4480-b145-8e4d06db929a'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:52 user nova-compute[75469]: INFO os_vif [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9')
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e905f7-637f-4d52-8e47-f16c74d4589f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:15:52 user nova-compute[75469]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:15:52 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:15:52 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 (non-flash)
Nov 14 05:15:52 user nova-compute[75469]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:15:52 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:15:52 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa74c3c2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65656ed-c116-46b4-8894-fcce7478c83e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c6df80-c385-482c-9444-d729c9d45115]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] No VIF found with MAC fa:16:3e:da:90:e0, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94f559c-744d-4e13-be4b-06a7ac524cfc]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:15:52 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b589ce7e-b63c-4bc5-8a94-534e622ae64e]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d66ef5-e6cb-4d77-9a4e-3455c3ef5d1e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7605630-8618-436d-8b51-dc811f5d58d9]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260]
Nov 14 05:15:53 user nova-compute[75469]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249, portal: 172.16.0.220,3260] successful.
Nov 14 05:15:53 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8102898-86af-4719-8b93-53819d13d249 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[92066160-c215-49b4-afad-9377d2a79469]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] <== disconnect_volume: return (1558ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG nova.objects.instance [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'flavor' on Instance uuid 67ad2387-630f-4066-b1eb-5c915b16232f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:15:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-850a20f2-dea2-46e9-804b-48a699932db8 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.841s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:15:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-28f61412-2e1c-453c-979c-72c99e70a797 req-37cd5d4e-16d0-4192-8dd0-f92195e165a3 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:15:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-28f61412-2e1c-453c-979c-72c99e70a797 req-37cd5d4e-16d0-4192-8dd0-f92195e165a3 service nova] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:15:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-28f61412-2e1c-453c-979c-72c99e70a797 req-37cd5d4e-16d0-4192-8dd0-f92195e165a3 service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:15:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-28f61412-2e1c-453c-979c-72c99e70a797 req-37cd5d4e-16d0-4192-8dd0-f92195e165a3 service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:15:54 user nova-compute[75469]: DEBUG nova.compute.manager [req-28f61412-2e1c-453c-979c-72c99e70a797 req-37cd5d4e-16d0-4192-8dd0-f92195e165a3 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] No waiting events found dispatching network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:15:54 user nova-compute[75469]: WARNING nova.compute.manager [req-28f61412-2e1c-453c-979c-72c99e70a797 req-37cd5d4e-16d0-4192-8dd0-f92195e165a3 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received unexpected event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 for instance with vm_state active and task_state resize_finish.
Nov 14 05:15:56 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:15:56 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Instance running successfully.
Nov 14 05:15:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Failed to set time: agent not configured {{(pid=75469) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 05:15:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e87ac7a2-0543-4490-b519-853e441ad50e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] finish_migration finished successfully. {{(pid=75469) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 05:15:56 user nova-compute[75469]: DEBUG nova.compute.manager [req-3235166d-126f-4a0b-87e5-eda30781cc29 req-6a7ed22d-bf9e-49cd-8889-6a987140d1eb service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:15:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3235166d-126f-4a0b-87e5-eda30781cc29 req-6a7ed22d-bf9e-49cd-8889-6a987140d1eb service nova] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:15:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3235166d-126f-4a0b-87e5-eda30781cc29 req-6a7ed22d-bf9e-49cd-8889-6a987140d1eb service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:15:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3235166d-126f-4a0b-87e5-eda30781cc29 req-6a7ed22d-bf9e-49cd-8889-6a987140d1eb service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:15:56 user nova-compute[75469]: DEBUG nova.compute.manager [req-3235166d-126f-4a0b-87e5-eda30781cc29 req-6a7ed22d-bf9e-49cd-8889-6a987140d1eb service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] No waiting events found dispatching network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:15:56 user nova-compute[75469]: WARNING nova.compute.manager [req-3235166d-126f-4a0b-87e5-eda30781cc29 req-6a7ed22d-bf9e-49cd-8889-6a987140d1eb service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received unexpected event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 for instance with vm_state resized and task_state None.
Nov 14 05:15:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:15:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:00 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:16:02 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:16:02 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8408MB free_disk=24.88097381591797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Applying migration context for instance a3c26481-d6c3-4480-b145-8e4d06db929a as it has an incoming, in-progress migration cbcd2f9f-8c66-48cb-8b84-747622963de9. Migration status is finished {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 05:16:02 user nova-compute[75469]: INFO nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating resource usage from migration cbcd2f9f-8c66-48cb-8b84-747622963de9
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 67ad2387-630f-4066-b1eb-5c915b16232f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c4a6a311-e640-471c-9b63-39d3a32a2796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 25fe6319-9929-4c0a-8c47-71ac31624899 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 22604611-34b5-40fa-8bda-86ddd0e0eb37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Migration cbcd2f9f-8c66-48cb-8b84-747622963de9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a3c26481-d6c3-4480-b145-8e4d06db929a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:16:04 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:16:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:16:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:16:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:16:04 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:16:04 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Updating instance_info_cache with network_info: [{"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:16:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:16:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:16:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:16:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:16:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "25fe6319-9929-4c0a-8c47-71ac31624899" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "25fe6319-9929-4c0a-8c47-71ac31624899" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:07 user nova-compute[75469]: INFO nova.compute.manager [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Terminating instance
Nov 14 05:16:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-a75aa9d5-6641-4395-9fc0-c2e1dc2640ee req-e2a4abcb-b5ae-4142-850f-511463250561 service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Received event network-vif-unplugged-70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a75aa9d5-6641-4395-9fc0-c2e1dc2640ee req-e2a4abcb-b5ae-4142-850f-511463250561 service nova] Acquiring lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a75aa9d5-6641-4395-9fc0-c2e1dc2640ee req-e2a4abcb-b5ae-4142-850f-511463250561 service nova] Lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a75aa9d5-6641-4395-9fc0-c2e1dc2640ee req-e2a4abcb-b5ae-4142-850f-511463250561 service nova] Lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-a75aa9d5-6641-4395-9fc0-c2e1dc2640ee req-e2a4abcb-b5ae-4142-850f-511463250561 service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] No waiting events found dispatching network-vif-unplugged-70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-a75aa9d5-6641-4395-9fc0-c2e1dc2640ee req-e2a4abcb-b5ae-4142-850f-511463250561 service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Received event network-vif-unplugged-70d12591-0849-4beb-b761-945c63fc737e for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:16:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Instance destroyed successfully.
Nov 14 05:16:08 user nova-compute[75469]: DEBUG nova.objects.instance [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lazy-loading 'resources' on Instance uuid 25fe6319-9929-4c0a-8c47-71ac31624899 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2050754636',display_name='tempest-ServersNegativeTestJSON-server-2050754636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2050754636',id=45,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:14:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39fc8e6026a4487b9288b15dee67072f',ramdisk_id='',reservation_id='r-3nkywyxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1402505206',owner_user_name='tempest-ServersNegativeTestJSON-1402505206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:14:23Z,user_data=None,user_id='7c8bacf3e4d54f8fb27f84f87c693e11',uuid=25fe6319-9929-4c0a-8c47-71ac31624899,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70d12591-0849-4beb-b761-945c63fc737e", "address": "fa:16:3e:e5:56:d9", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d12591-08", "ovs_interfaceid": "70d12591-0849-4beb-b761-945c63fc737e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converting VIF {"id": "70d12591-0849-4beb-b761-945c63fc737e", "address": "fa:16:3e:e5:56:d9", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d12591-08", "ovs_interfaceid": "70d12591-0849-4beb-b761-945c63fc737e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:56:d9,bridge_name='br-int',has_traffic_filtering=True,id=70d12591-0849-4beb-b761-945c63fc737e,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d12591-08') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG os_vif [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:56:d9,bridge_name='br-int',has_traffic_filtering=True,id=70d12591-0849-4beb-b761-945c63fc737e,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d12591-08') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70d12591-08, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15c280b4-950d-4119-aa59-945fd6e3e648) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:16:08 user nova-compute[75469]: INFO os_vif [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:56:d9,bridge_name='br-int',has_traffic_filtering=True,id=70d12591-0849-4beb-b761-945c63fc737e,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d12591-08')
Nov 14 05:16:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Deleting instance files /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899_del
Nov 14 05:16:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Deletion of /opt/stack/data/nova/instances/25fe6319-9929-4c0a-8c47-71ac31624899_del complete
Nov 14 05:16:08 user nova-compute[75469]: INFO nova.compute.manager [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 05:16:08 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:08 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:16:09 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Took 0.62 seconds to deallocate network for instance.
Nov 14 05:16:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-db6e0726-c8d8-408d-a166-fe5bd8b64d32 req-b5dcb9ab-9f4d-446d-b3d9-e9f5f9543528 service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Received event network-vif-deleted-70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:16:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:16:09 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:16:09 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:16:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:09 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Deleted allocations for instance 25fe6319-9929-4c0a-8c47-71ac31624899
Nov 14 05:16:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5ba600bb-7366-41a9-8f4c-07946531aa13 tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "25fe6319-9929-4c0a-8c47-71ac31624899" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.897s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-2fe82385-9c8c-46eb-b252-34b00a2b9ae7 req-1390c985-90be-4627-a490-80d4beca6f14 service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Received event network-vif-plugged-70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:16:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2fe82385-9c8c-46eb-b252-34b00a2b9ae7 req-1390c985-90be-4627-a490-80d4beca6f14 service nova] Acquiring lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2fe82385-9c8c-46eb-b252-34b00a2b9ae7 req-1390c985-90be-4627-a490-80d4beca6f14 service nova] Lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2fe82385-9c8c-46eb-b252-34b00a2b9ae7 req-1390c985-90be-4627-a490-80d4beca6f14 service nova] Lock "25fe6319-9929-4c0a-8c47-71ac31624899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-2fe82385-9c8c-46eb-b252-34b00a2b9ae7 req-1390c985-90be-4627-a490-80d4beca6f14 service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] No waiting events found dispatching network-vif-plugged-70d12591-0849-4beb-b761-945c63fc737e {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:16:09 user nova-compute[75469]: WARNING nova.compute.manager [req-2fe82385-9c8c-46eb-b252-34b00a2b9ae7 req-1390c985-90be-4627-a490-80d4beca6f14 service nova] [instance: 25fe6319-9929-4c0a-8c47-71ac31624899] Received unexpected event network-vif-plugged-70d12591-0849-4beb-b761-945c63fc737e for instance with vm_state deleted and task_state None.
Nov 14 05:16:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:16:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:16:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-55279903-9365-4144-9a6b-ca1d99d9fe68 req-49e357c9-3036-4b6d-93d6-95357e846602 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received event network-changed-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:16:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-55279903-9365-4144-9a6b-ca1d99d9fe68 req-49e357c9-3036-4b6d-93d6-95357e846602 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Refreshing instance network info cache due to event network-changed-889c8c86-6ec3-40a1-8761-92721c773e2a. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:16:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-55279903-9365-4144-9a6b-ca1d99d9fe68 req-49e357c9-3036-4b6d-93d6-95357e846602 service nova] Acquiring lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:16:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-55279903-9365-4144-9a6b-ca1d99d9fe68 req-49e357c9-3036-4b6d-93d6-95357e846602 service nova] Acquired lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:16:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-55279903-9365-4144-9a6b-ca1d99d9fe68 req-49e357c9-3036-4b6d-93d6-95357e846602 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Refreshing network info cache for port 889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:16:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-55279903-9365-4144-9a6b-ca1d99d9fe68 req-49e357c9-3036-4b6d-93d6-95357e846602 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Updated VIF entry in instance network info cache for port 889c8c86-6ec3-40a1-8761-92721c773e2a. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:16:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-55279903-9365-4144-9a6b-ca1d99d9fe68 req-49e357c9-3036-4b6d-93d6-95357e846602 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Updating instance_info_cache with network_info: [{"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:16:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-55279903-9365-4144-9a6b-ca1d99d9fe68 req-49e357c9-3036-4b6d-93d6-95357e846602 service nova] Releasing lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:16:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:16:23 user nova-compute[75469]: INFO nova.compute.claims [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Claim successful on node user
Nov 14 05:16:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:16:23 user nova-compute[75469]: INFO nova.compute.manager [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Terminating instance
Nov 14 05:16:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:23 user nova-compute[75469]: INFO nova.virt.block_device [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Booting with volume 88f3ae3c-cc17-49be-bbae-5295dbe82564 at /dev/vda
Nov 14 05:16:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG nova.policy [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0155ca3745514d6c8c0ab08a9182df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf022cc839af44ff89e4249410c4a9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG os_brick.utils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b3c187-9b4b-4f9f-b708-7d37a82e9083]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64bb6ce-9d3e-4883-99c7-88c660d9cce7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb77b4f-e607-4643-96e9-daefa5e6c7be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e804320-451b-4d43-b87e-9a22ff40e9b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:16:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:16:24 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:16:24 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1184e3f4-98a4-411a-8f94-cced4319fc6d]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG os_brick.utils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Updating existing volume attachment record: 5942a866-6e4c-4f2e-80a5-82724a29f932 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-a3c7276b-682a-48a1-bb2b-5fe77a636c1b req-950ef3de-b966-499f-b729-c35ba11b8ccc service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-vif-unplugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a3c7276b-682a-48a1-bb2b-5fe77a636c1b req-950ef3de-b966-499f-b729-c35ba11b8ccc service nova] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a3c7276b-682a-48a1-bb2b-5fe77a636c1b req-950ef3de-b966-499f-b729-c35ba11b8ccc service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a3c7276b-682a-48a1-bb2b-5fe77a636c1b req-950ef3de-b966-499f-b729-c35ba11b8ccc service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-a3c7276b-682a-48a1-bb2b-5fe77a636c1b req-950ef3de-b966-499f-b729-c35ba11b8ccc service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] No waiting events found dispatching network-vif-unplugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-a3c7276b-682a-48a1-bb2b-5fe77a636c1b req-950ef3de-b966-499f-b729-c35ba11b8ccc service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-vif-unplugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:16:24 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Instance destroyed successfully.
Nov 14 05:16:24 user nova-compute[75469]: DEBUG nova.objects.instance [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'resources' on Instance uuid 67ad2387-630f-4066-b1eb-5c915b16232f {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754582521',display_name='tempest-TestMinimumBasicScenario-server-754582521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754582521',id=41,image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdn1x0SKdYYLCaB5aogNfyXlQllNVgU2V9rN6tlqiyZC6vNZwxiijQz42jIjTuGsw+EMMki730cHdn1TpeLr4rHn54ZYliYxshD7hA5TC5owk6EoWBzILFVaSibpTEvrw==',key_name='tempest-TestMinimumBasicScenario-1213478591',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:11:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0d0f57326454312bee742d698e94a3b',ramdisk_id='',reservation_id='r-wbj1wlwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fd65ed82-e150-4a4e-a620-4b8e761d1930',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1786662085',owner_user_name='tempest-TestMinimumBasicScenario-1786662085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:13:46Z,user_data=None,user_id='7864a212cd5548f6a8b3d07a3e4a2d58',uuid=67ad2387-630f-4066-b1eb-5c915b16232f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converting VIF {"id": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "address": "fa:16:3e:9a:ba:f5", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37573211-71", "ovs_interfaceid": "37573211-71cc-4684-8d46-5ed2ee9ffae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG os_vif [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37573211-71, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6c18ab0-0736-4339-b8de-0889a88f20d4) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:16:24 user nova-compute[75469]: INFO os_vif [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ba:f5,bridge_name='br-int',has_traffic_filtering=True,id=37573211-71cc-4684-8d46-5ed2ee9ffae7,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37573211-71')
Nov 14 05:16:24 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Deleting instance files /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f_del
Nov 14 05:16:24 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Deletion of /opt/stack/data/nova/instances/67ad2387-630f-4066-b1eb-5c915b16232f_del complete
Nov 14 05:16:24 user nova-compute[75469]: INFO nova.compute.manager [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 05:16:24 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:16:24 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Successfully created port: 3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:16:25 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Took 0.73 seconds to deallocate network for instance.
Nov 14 05:16:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-191d0d8f-87a9-457b-85e4-a44d1bbb843c req-1fddac68-e8bc-44dc-8fec-6f7c7269ed66 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-vif-deleted-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:16:25 user nova-compute[75469]: INFO nova.compute.manager [req-191d0d8f-87a9-457b-85e4-a44d1bbb843c req-1fddac68-e8bc-44dc-8fec-6f7c7269ed66 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Neutron deleted interface 37573211-71cc-4684-8d46-5ed2ee9ffae7; detaching it from the instance and deleting it from the info cache
Nov 14 05:16:25 user nova-compute[75469]: DEBUG nova.network.neutron [req-191d0d8f-87a9-457b-85e4-a44d1bbb843c req-1fddac68-e8bc-44dc-8fec-6f7c7269ed66 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-191d0d8f-87a9-457b-85e4-a44d1bbb843c req-1fddac68-e8bc-44dc-8fec-6f7c7269ed66 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Detach interface failed, port_id=37573211-71cc-4684-8d46-5ed2ee9ffae7, reason: Instance 67ad2387-630f-4066-b1eb-5c915b16232f could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:25 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Deleted allocations for instance 67ad2387-630f-4066-b1eb-5c915b16232f
Nov 14 05:16:25 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Successfully updated port: 3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquired lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-f0ac8491-cda0-43cb-a6e0-ba242baeb3cf tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "67ad2387-630f-4066-b1eb-5c915b16232f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.042s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:25 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:16:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Updating instance_info_cache with network_info: [{"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:16:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Releasing lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:16:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Instance network_info: |[{"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:16:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-5e158d61-0047-4929-af91-8ede8de139ad req-c61652b1-0f67-41b2-bc18-581521d24f20 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:16:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5e158d61-0047-4929-af91-8ede8de139ad req-c61652b1-0f67-41b2-bc18-581521d24f20 service nova] Acquiring lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5e158d61-0047-4929-af91-8ede8de139ad req-c61652b1-0f67-41b2-bc18-581521d24f20 service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5e158d61-0047-4929-af91-8ede8de139ad req-c61652b1-0f67-41b2-bc18-581521d24f20 service nova] Lock "67ad2387-630f-4066-b1eb-5c915b16232f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-5e158d61-0047-4929-af91-8ede8de139ad req-c61652b1-0f67-41b2-bc18-581521d24f20 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] No waiting events found dispatching network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:16:26 user nova-compute[75469]: WARNING nova.compute.manager [req-5e158d61-0047-4929-af91-8ede8de139ad req-c61652b1-0f67-41b2-bc18-581521d24f20 service nova] [instance: 67ad2387-630f-4066-b1eb-5c915b16232f] Received unexpected event network-vif-plugged-37573211-71cc-4684-8d46-5ed2ee9ffae7 for instance with vm_state deleted and task_state None.
Nov 14 05:16:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-eee6002a-e797-4bec-88d8-e071498283b5 req-90de4d01-9f31-47fc-a0ff-28bd3e570025 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received event network-changed-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:16:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-eee6002a-e797-4bec-88d8-e071498283b5 req-90de4d01-9f31-47fc-a0ff-28bd3e570025 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Refreshing instance network info cache due to event network-changed-3d8c0cd8-8262-4a15-ace6-8f229b05172f. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:16:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eee6002a-e797-4bec-88d8-e071498283b5 req-90de4d01-9f31-47fc-a0ff-28bd3e570025 service nova] Acquiring lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:16:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eee6002a-e797-4bec-88d8-e071498283b5 req-90de4d01-9f31-47fc-a0ff-28bd3e570025 service nova] Acquired lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:16:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-eee6002a-e797-4bec-88d8-e071498283b5 req-90de4d01-9f31-47fc-a0ff-28bd3e570025 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Refreshing network info cache for port 3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:16:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-eee6002a-e797-4bec-88d8-e071498283b5 req-90de4d01-9f31-47fc-a0ff-28bd3e570025 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Updated VIF entry in instance network info cache for port 3d8c0cd8-8262-4a15-ace6-8f229b05172f. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:16:27 user nova-compute[75469]: DEBUG nova.network.neutron [req-eee6002a-e797-4bec-88d8-e071498283b5 req-90de4d01-9f31-47fc-a0ff-28bd3e570025 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Updating instance_info_cache with network_info: [{"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:16:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-eee6002a-e797-4bec-88d8-e071498283b5 req-90de4d01-9f31-47fc-a0ff-28bd3e570025 service nova] Releasing lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:16:28 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Creating image(s)
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Did not create local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Ensure instance console log exists: /opt/stack/data/nova/instances/c0455d12-633d-4dbd-86e7-9b2fd98a9e0d/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Start _get_guest_xml network_info=[{"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '5942a866-6e4c-4f2e-80a5-82724a29f932', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDFAKMJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0455d12-633d-4dbd-86e7-9b2fd98a9e0d', 'attached_at': '', 'detached_at': '', 'volume_id': '88f3ae3c-cc17-49be-bbae-5295dbe82564', 'serial': '88f3ae3c-cc17-49be-bbae-5295dbe82564'}, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:16:28 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:16:28 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDFAKMJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:16:28 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:16:28 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:16:28 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1999da-a7c3-4106-aa82-0088c637af7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:16:28 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1515b225-8d22-4036-82a3-62818a186708]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564] added
Nov 14 05:16:28 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[657a985c-c2dc-490f-aa70-e20d6716800e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[55317cc5-0ed9-4387-b1c4-86f28394163d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDFAKMJp {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDFAKMJp" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d1c4c1-c6ad-4ca8-b123-4224ef06d5e4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TDFAKMJp'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b97baf-dfb5-4785-91d8-ed72bbb1fbf3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d6dc4-da8b-4aa2-9d94-4366400ce7c3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:16:28 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:16:28 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:16:28 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:16:28 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b979edc-35ab-49db-9c77-db87e25d8639]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564, portal: 172.16.0.220,3260]
Nov 14 05:16:28 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564, portal: 172.16.0.220,3260] successful.
Nov 14 05:16:28 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7c24e1-e886-498b-a0d5-908825b681c0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7088091b-1fcb-4a55-8ef3-be4b832e866a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:16:28 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:16:28 user nova-compute[75469]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 (non-flash)
Nov 14 05:16:28 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:16:28 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:16:28 user nova-compute[75469]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 (non-flash)
Nov 14 05:16:28 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ec4ea6-7558-434c-9971-25e1e7ffd9a1]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:16:28 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDFAKMJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23839656330343538', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839656330343538', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1508294757',display_name='tempest-TestVolumeBootPattern-server-1508294757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1508294757',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfogU6kYPcp7NAmuZGDid0UKyqw1IdjLF3ZnJERaUBDZkL+xPoChg6A1IGhqjD7zf4jVDGbb4+dyNskSlHAeBsABrlV8tujEJoboi7nPt7TAeLT6Bss/BpxghYXarJuXw==',key_name='tempest-TestVolumeBootPattern-247749559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-pb854guo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:16:24Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=c0455d12-633d-4dbd-86e7-9b2fd98a9e0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1a:0b,bridge_name='br-int',has_traffic_filtering=True,id=3d8c0cd8-8262-4a15-ace6-8f229b05172f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8c0cd8-82') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'pci_devices' on Instance uuid c0455d12-633d-4dbd-86e7-9b2fd98a9e0d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:16:29 user nova-compute[75469]:   <uuid>c0455d12-633d-4dbd-86e7-9b2fd98a9e0d</uuid>
Nov 14 05:16:29 user nova-compute[75469]:   <name>instance-0000002f</name>
Nov 14 05:16:29 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:16:29 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:16:29 user nova-compute[75469]:   <metadata>
Nov 14 05:16:29 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:16:29 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:16:29 user nova-compute[75469]:       <nova:name>tempest-TestVolumeBootPattern-server-1508294757</nova:name>
Nov 14 05:16:29 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:16:28</nova:creationTime>
Nov 14 05:16:29 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:16:29 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:16:29 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:16:29 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:16:29 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:16:29 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:16:29 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:16:29 user nova-compute[75469]:       <nova:owner>
Nov 14 05:16:29 user nova-compute[75469]:         <nova:user uuid="0155ca3745514d6c8c0ab08a9182df53">tempest-TestVolumeBootPattern-43343925-project-member</nova:user>
Nov 14 05:16:29 user nova-compute[75469]:         <nova:project uuid="bf022cc839af44ff89e4249410c4a9e4">tempest-TestVolumeBootPattern-43343925</nova:project>
Nov 14 05:16:29 user nova-compute[75469]:       </nova:owner>
Nov 14 05:16:29 user nova-compute[75469]:       <nova:ports>
Nov 14 05:16:29 user nova-compute[75469]:         <nova:port uuid="3d8c0cd8-8262-4a15-ace6-8f229b05172f">
Nov 14 05:16:29 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 05:16:29 user nova-compute[75469]:         </nova:port>
Nov 14 05:16:29 user nova-compute[75469]:       </nova:ports>
Nov 14 05:16:29 user nova-compute[75469]:     </nova:instance>
Nov 14 05:16:29 user nova-compute[75469]:   </metadata>
Nov 14 05:16:29 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:16:29 user nova-compute[75469]:     <system>
Nov 14 05:16:29 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:16:29 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:16:29 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:16:29 user nova-compute[75469]:       <entry name="serial">c0455d12-633d-4dbd-86e7-9b2fd98a9e0d</entry>
Nov 14 05:16:29 user nova-compute[75469]:       <entry name="uuid">c0455d12-633d-4dbd-86e7-9b2fd98a9e0d</entry>
Nov 14 05:16:29 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:16:29 user nova-compute[75469]:     </system>
Nov 14 05:16:29 user nova-compute[75469]:   </sysinfo>
Nov 14 05:16:29 user nova-compute[75469]:   <os>
Nov 14 05:16:29 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:16:29 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:16:29 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:16:29 user nova-compute[75469]:   </os>
Nov 14 05:16:29 user nova-compute[75469]:   <features>
Nov 14 05:16:29 user nova-compute[75469]:     <acpi/>
Nov 14 05:16:29 user nova-compute[75469]:     <apic/>
Nov 14 05:16:29 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:16:29 user nova-compute[75469]:   </features>
Nov 14 05:16:29 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:16:29 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:16:29 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:16:29 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:16:29 user nova-compute[75469]:   </clock>
Nov 14 05:16:29 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:16:29 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:16:29 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:16:29 user nova-compute[75469]:   </cpu>
Nov 14 05:16:29 user nova-compute[75469]:   <devices>
Nov 14 05:16:29 user nova-compute[75469]:     <disk type="block" device="disk">
Nov 14 05:16:29 user nova-compute[75469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:16:29 user nova-compute[75469]:       <source dev="/dev/sdb"/>
Nov 14 05:16:29 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:16:29 user nova-compute[75469]:       <serial>88f3ae3c-cc17-49be-bbae-5295dbe82564</serial>
Nov 14 05:16:29 user nova-compute[75469]:     </disk>
Nov 14 05:16:29 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:16:29 user nova-compute[75469]:       <mac address="fa:16:3e:dc:1a:0b"/>
Nov 14 05:16:29 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:16:29 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:16:29 user nova-compute[75469]:       <target dev="tap3d8c0cd8-82"/>
Nov 14 05:16:29 user nova-compute[75469]:     </interface>
Nov 14 05:16:29 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:16:29 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/c0455d12-633d-4dbd-86e7-9b2fd98a9e0d/console.log" append="off"/>
Nov 14 05:16:29 user nova-compute[75469]:     </serial>
Nov 14 05:16:29 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:16:29 user nova-compute[75469]:     <video>
Nov 14 05:16:29 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:16:29 user nova-compute[75469]:     </video>
Nov 14 05:16:29 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:16:29 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:16:29 user nova-compute[75469]:     </rng>
Nov 14 05:16:29 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:16:29 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:16:29 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:16:29 user nova-compute[75469]:     </memballoon>
Nov 14 05:16:29 user nova-compute[75469]:   </devices>
Nov 14 05:16:29 user nova-compute[75469]: </domain>
Nov 14 05:16:29 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1508294757',display_name='tempest-TestVolumeBootPattern-server-1508294757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1508294757',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfogU6kYPcp7NAmuZGDid0UKyqw1IdjLF3ZnJERaUBDZkL+xPoChg6A1IGhqjD7zf4jVDGbb4+dyNskSlHAeBsABrlV8tujEJoboi7nPt7TAeLT6Bss/BpxghYXarJuXw==',key_name='tempest-TestVolumeBootPattern-247749559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-pb854guo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:16:24Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=c0455d12-633d-4dbd-86e7-9b2fd98a9e0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1a:0b,bridge_name='br-int',has_traffic_filtering=True,id=3d8c0cd8-8262-4a15-ace6-8f229b05172f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8c0cd8-82') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG os_vif [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1a:0b,bridge_name='br-int',has_traffic_filtering=True,id=3d8c0cd8-8262-4a15-ace6-8f229b05172f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8c0cd8-82') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '290aa59a-ad38-58dd-8f38-11964d16939d', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d8c0cd8-82, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d8c0cd8-82, col_values=(('qos', UUID('4d9d3235-ef58-4b0e-8854-77b07b3c5479')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d8c0cd8-82, col_values=(('external_ids', {'iface-id': '3d8c0cd8-8262-4a15-ace6-8f229b05172f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:1a:0b', 'vm-uuid': 'c0455d12-633d-4dbd-86e7-9b2fd98a9e0d'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:29 user nova-compute[75469]: INFO os_vif [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1a:0b,bridge_name='br-int',has_traffic_filtering=True,id=3d8c0cd8-8262-4a15-ace6-8f229b05172f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8c0cd8-82')
Nov 14 05:16:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:16:29 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] No VIF found with MAC fa:16:3e:dc:1a:0b, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:16:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-dedf679e-5a1b-4fd8-8676-b8d6063a37c2 req-b74512d9-d373-4b95-b24c-181f1ac75064 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received event network-vif-plugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:16:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dedf679e-5a1b-4fd8-8676-b8d6063a37c2 req-b74512d9-d373-4b95-b24c-181f1ac75064 service nova] Acquiring lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dedf679e-5a1b-4fd8-8676-b8d6063a37c2 req-b74512d9-d373-4b95-b24c-181f1ac75064 service nova] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-dedf679e-5a1b-4fd8-8676-b8d6063a37c2 req-b74512d9-d373-4b95-b24c-181f1ac75064 service nova] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-dedf679e-5a1b-4fd8-8676-b8d6063a37c2 req-b74512d9-d373-4b95-b24c-181f1ac75064 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] No waiting events found dispatching network-vif-plugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:16:31 user nova-compute[75469]: WARNING nova.compute.manager [req-dedf679e-5a1b-4fd8-8676-b8d6063a37c2 req-b74512d9-d373-4b95-b24c-181f1ac75064 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received unexpected event network-vif-plugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f for instance with vm_state building and task_state spawning.
Nov 14 05:16:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:16:33 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Instance spawned successfully.
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:16:33 user nova-compute[75469]: INFO nova.compute.manager [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.compute.manager [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.compute.manager [req-4926f587-8095-41f6-a521-59264b5b42b8 req-41fd2eae-a3b1-427f-b182-49b73da52f2a service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received event network-vif-plugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4926f587-8095-41f6-a521-59264b5b42b8 req-41fd2eae-a3b1-427f-b182-49b73da52f2a service nova] Acquiring lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4926f587-8095-41f6-a521-59264b5b42b8 req-41fd2eae-a3b1-427f-b182-49b73da52f2a service nova] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-4926f587-8095-41f6-a521-59264b5b42b8 req-41fd2eae-a3b1-427f-b182-49b73da52f2a service nova] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:33 user nova-compute[75469]: DEBUG nova.compute.manager [req-4926f587-8095-41f6-a521-59264b5b42b8 req-41fd2eae-a3b1-427f-b182-49b73da52f2a service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] No waiting events found dispatching network-vif-plugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:16:33 user nova-compute[75469]: WARNING nova.compute.manager [req-4926f587-8095-41f6-a521-59264b5b42b8 req-41fd2eae-a3b1-427f-b182-49b73da52f2a service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received unexpected event network-vif-plugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f for instance with vm_state building and task_state spawning.
Nov 14 05:16:33 user nova-compute[75469]: INFO nova.compute.manager [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Took 10.13 seconds to build instance.
Nov 14 05:16:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4236ae12-0933-400a-b4ed-906ba0005333 tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.227s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:16:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:16:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:16:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:17:02 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:17:02 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8373MB free_disk=24.91897964477539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Applying migration context for instance a3c26481-d6c3-4480-b145-8e4d06db929a as it has an incoming, in-progress migration cbcd2f9f-8c66-48cb-8b84-747622963de9. Migration status is finished {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 05:17:02 user nova-compute[75469]: INFO nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating resource usage from migration cbcd2f9f-8c66-48cb-8b84-747622963de9
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c4a6a311-e640-471c-9b63-39d3a32a2796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 22604611-34b5-40fa-8bda-86ddd0e0eb37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Migration cbcd2f9f-8c66-48cb-8b84-747622963de9 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a3c26481-d6c3-4480-b145-8e4d06db929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c0455d12-633d-4dbd-86e7-9b2fd98a9e0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:17:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:04 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:17:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:17:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:17:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:17:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:17:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:17:05 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid d742ff9e-3b9f-4d3f-9825-3d3361765b24 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:17:05 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updating instance_info_cache with network_info: [{"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:17:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:17:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:17:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:17:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:17:07 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:17:07 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:17:08 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:17:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:17:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:17:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:17:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:17:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:17:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:17:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:17:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:12 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:17:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:17:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:17 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:17:17 user nova-compute[75469]: INFO nova.compute.claims [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Claim successful on node user
Nov 14 05:17:18 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:17:18 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:17:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG nova.policy [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7864a212cd5548f6a8b3d07a3e4a2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d0f57326454312bee742d698e94a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:17:18 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Creating image(s)
Nov 14 05:17:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "/opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "/opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "/opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "9d40f7d4b52495c0538560304d45d935597cd4be" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "9d40f7d4b52495c0538560304d45d935597cd4be" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be.part --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Successfully created port: 8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG nova.virt.images [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] 5d0c673d-4a37-49fb-9f5c-074d4e56e818 was qcow2, converting to raw {{(pid=75469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG nova.privsep.utils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be.part /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be.converted {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be.part /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be.converted" returned: 0 in 0.156s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be.converted --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "9d40f7d4b52495c0538560304d45d935597cd4be" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.962s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "9d40f7d4b52495c0538560304d45d935597cd4be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "9d40f7d4b52495c0538560304d45d935597cd4be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Successfully updated port: 8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquired lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be --force-share --output=json" returned: 0 in 0.193s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be,backing_fmt=raw /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-268ee43c-4789-4856-b11d-bf1b775eb9e6 req-7d4a462a-fabc-4f63-a897-9c35b10f10a3 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-changed-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-268ee43c-4789-4856-b11d-bf1b775eb9e6 req-7d4a462a-fabc-4f63-a897-9c35b10f10a3 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Refreshing instance network info cache due to event network-changed-8a528dd1-bb85-429c-9278-20c4ce221d49. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-268ee43c-4789-4856-b11d-bf1b775eb9e6 req-7d4a462a-fabc-4f63-a897-9c35b10f10a3 service nova] Acquiring lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG nova.network.neutron [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be,backing_fmt=raw /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk 1073741824" returned: 0 in 0.073s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "9d40f7d4b52495c0538560304d45d935597cd4be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.network.neutron [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updating instance_info_cache with network_info: [{"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Releasing lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Instance network_info: |[{"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-268ee43c-4789-4856-b11d-bf1b775eb9e6 req-7d4a462a-fabc-4f63-a897-9c35b10f10a3 service nova] Acquired lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.network.neutron [req-268ee43c-4789-4856-b11d-bf1b775eb9e6 req-7d4a462a-fabc-4f63-a897-9c35b10f10a3 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Refreshing network info cache for port 8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Cannot resize image /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Ensure instance console log exists: /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Start _get_guest_xml network_info=[{"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T05:17:15Z,direct_url=<?>,disk_format='qcow2',id=5d0c673d-4a37-49fb-9f5c-074d4e56e818,min_disk=0,min_ram=0,name='tempest-scenario-img--521965555',owner='d0d0f57326454312bee742d698e94a3b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T05:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '5d0c673d-4a37-49fb-9f5c-074d4e56e818'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:17:20 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:17:20 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T05:17:15Z,direct_url=<?>,disk_format='qcow2',id=5d0c673d-4a37-49fb-9f5c-074d4e56e818,min_disk=0,min_ram=0,name='tempest-scenario-img--521965555',owner='d0d0f57326454312bee742d698e94a3b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T05:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-148707394',display_name='tempest-TestMinimumBasicScenario-server-148707394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-148707394',id=48,image_ref='5d0c673d-4a37-49fb-9f5c-074d4e56e818',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOTvnb1Ix79bhElB+kW+p12c+a2upNZpt3aMMLESudfuu/XKxN0v9ttwaBsJ+vT6nSSSX14CXGwgTJ2ws4N12o+6t86PK05H+3cJuHZTxtCJGbvzxqH9RSgJEzFnzPGRw==',key_name='tempest-TestMinimumBasicScenario-1719305429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d0f57326454312bee742d698e94a3b',ramdisk_id='',reservation_id='r-q8isql5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d0c673d-4a37-49fb-9f5c-074d4e56e818',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1786662085',owner_user_name='tempest-TestMinimumBasicScenario-1786662085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:17:18Z,user_data=None,user_id='7864a212cd5548f6a8b3d07a3e4a2d58',uuid=36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converting VIF {"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:9c:82,bridge_name='br-int',has_traffic_filtering=True,id=8a528dd1-bb85-429c-9278-20c4ce221d49,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a528dd1-bb') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.objects.instance [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'pci_devices' on Instance uuid 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:17:20 user nova-compute[75469]:   <uuid>36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af</uuid>
Nov 14 05:17:20 user nova-compute[75469]:   <name>instance-00000030</name>
Nov 14 05:17:20 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:17:20 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:17:20 user nova-compute[75469]:   <metadata>
Nov 14 05:17:20 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:17:20 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:17:20 user nova-compute[75469]:       <nova:name>tempest-TestMinimumBasicScenario-server-148707394</nova:name>
Nov 14 05:17:20 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:17:20</nova:creationTime>
Nov 14 05:17:20 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:17:20 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:17:20 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:17:20 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:17:20 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:17:20 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:17:20 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:17:20 user nova-compute[75469]:       <nova:owner>
Nov 14 05:17:20 user nova-compute[75469]:         <nova:user uuid="7864a212cd5548f6a8b3d07a3e4a2d58">tempest-TestMinimumBasicScenario-1786662085-project-member</nova:user>
Nov 14 05:17:20 user nova-compute[75469]:         <nova:project uuid="d0d0f57326454312bee742d698e94a3b">tempest-TestMinimumBasicScenario-1786662085</nova:project>
Nov 14 05:17:20 user nova-compute[75469]:       </nova:owner>
Nov 14 05:17:20 user nova-compute[75469]:       <nova:root type="image" uuid="5d0c673d-4a37-49fb-9f5c-074d4e56e818"/>
Nov 14 05:17:20 user nova-compute[75469]:       <nova:ports>
Nov 14 05:17:20 user nova-compute[75469]:         <nova:port uuid="8a528dd1-bb85-429c-9278-20c4ce221d49">
Nov 14 05:17:20 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 05:17:20 user nova-compute[75469]:         </nova:port>
Nov 14 05:17:20 user nova-compute[75469]:       </nova:ports>
Nov 14 05:17:20 user nova-compute[75469]:     </nova:instance>
Nov 14 05:17:20 user nova-compute[75469]:   </metadata>
Nov 14 05:17:20 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:17:20 user nova-compute[75469]:     <system>
Nov 14 05:17:20 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:17:20 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:17:20 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:17:20 user nova-compute[75469]:       <entry name="serial">36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af</entry>
Nov 14 05:17:20 user nova-compute[75469]:       <entry name="uuid">36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af</entry>
Nov 14 05:17:20 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:17:20 user nova-compute[75469]:     </system>
Nov 14 05:17:20 user nova-compute[75469]:   </sysinfo>
Nov 14 05:17:20 user nova-compute[75469]:   <os>
Nov 14 05:17:20 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:17:20 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:17:20 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:17:20 user nova-compute[75469]:   </os>
Nov 14 05:17:20 user nova-compute[75469]:   <features>
Nov 14 05:17:20 user nova-compute[75469]:     <acpi/>
Nov 14 05:17:20 user nova-compute[75469]:     <apic/>
Nov 14 05:17:20 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:17:20 user nova-compute[75469]:   </features>
Nov 14 05:17:20 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:17:20 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:17:20 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:17:20 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:17:20 user nova-compute[75469]:   </clock>
Nov 14 05:17:20 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:17:20 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:17:20 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:17:20 user nova-compute[75469]:   </cpu>
Nov 14 05:17:20 user nova-compute[75469]:   <devices>
Nov 14 05:17:20 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:17:20 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:17:20 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk"/>
Nov 14 05:17:20 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:17:20 user nova-compute[75469]:     </disk>
Nov 14 05:17:20 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:17:20 user nova-compute[75469]:       <mac address="fa:16:3e:99:9c:82"/>
Nov 14 05:17:20 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:17:20 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:17:20 user nova-compute[75469]:       <target dev="tap8a528dd1-bb"/>
Nov 14 05:17:20 user nova-compute[75469]:     </interface>
Nov 14 05:17:20 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:17:20 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/console.log" append="off"/>
Nov 14 05:17:20 user nova-compute[75469]:     </serial>
Nov 14 05:17:20 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:17:20 user nova-compute[75469]:     <video>
Nov 14 05:17:20 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:17:20 user nova-compute[75469]:     </video>
Nov 14 05:17:20 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:17:20 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:17:20 user nova-compute[75469]:     </rng>
Nov 14 05:17:20 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:17:20 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:17:20 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:17:20 user nova-compute[75469]:     </memballoon>
Nov 14 05:17:20 user nova-compute[75469]:   </devices>
Nov 14 05:17:20 user nova-compute[75469]: </domain>
Nov 14 05:17:20 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-148707394',display_name='tempest-TestMinimumBasicScenario-server-148707394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-148707394',id=48,image_ref='5d0c673d-4a37-49fb-9f5c-074d4e56e818',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOTvnb1Ix79bhElB+kW+p12c+a2upNZpt3aMMLESudfuu/XKxN0v9ttwaBsJ+vT6nSSSX14CXGwgTJ2ws4N12o+6t86PK05H+3cJuHZTxtCJGbvzxqH9RSgJEzFnzPGRw==',key_name='tempest-TestMinimumBasicScenario-1719305429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d0f57326454312bee742d698e94a3b',ramdisk_id='',reservation_id='r-q8isql5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d0c673d-4a37-49fb-9f5c-074d4e56e818',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1786662085',owner_user_name='tempest-TestMinimumBasicScenario-1786662085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:17:18Z,user_data=None,user_id='7864a212cd5548f6a8b3d07a3e4a2d58',uuid=36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converting VIF {"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:9c:82,bridge_name='br-int',has_traffic_filtering=True,id=8a528dd1-bb85-429c-9278-20c4ce221d49,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a528dd1-bb') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG os_vif [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:9c:82,bridge_name='br-int',has_traffic_filtering=True,id=8a528dd1-bb85-429c-9278-20c4ce221d49,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a528dd1-bb') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5500ade-d74e-5967-a39e-c342f5f586bb', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a528dd1-bb, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a528dd1-bb, col_values=(('qos', UUID('e658d07c-f342-459b-ad57-4bcdbe4a1228')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a528dd1-bb, col_values=(('external_ids', {'iface-id': '8a528dd1-bb85-429c-9278-20c4ce221d49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:9c:82', 'vm-uuid': '36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:20 user nova-compute[75469]: INFO os_vif [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:9c:82,bridge_name='br-int',has_traffic_filtering=True,id=8a528dd1-bb85-429c-9278-20c4ce221d49,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a528dd1-bb')
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] No VIF found with MAC fa:16:3e:99:9c:82, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.network.neutron [req-268ee43c-4789-4856-b11d-bf1b775eb9e6 req-7d4a462a-fabc-4f63-a897-9c35b10f10a3 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updated VIF entry in instance network info cache for port 8a528dd1-bb85-429c-9278-20c4ce221d49. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG nova.network.neutron [req-268ee43c-4789-4856-b11d-bf1b775eb9e6 req-7d4a462a-fabc-4f63-a897-9c35b10f10a3 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updating instance_info_cache with network_info: [{"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:17:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-268ee43c-4789-4856-b11d-bf1b775eb9e6 req-7d4a462a-fabc-4f63-a897-9c35b10f10a3 service nova] Releasing lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:17:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-e2a98702-5b70-41a4-92f1-2e47bd4d3286 req-70f4d018-98ae-449f-af49-c9a142983e17 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:17:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e2a98702-5b70-41a4-92f1-2e47bd4d3286 req-70f4d018-98ae-449f-af49-c9a142983e17 service nova] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e2a98702-5b70-41a4-92f1-2e47bd4d3286 req-70f4d018-98ae-449f-af49-c9a142983e17 service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e2a98702-5b70-41a4-92f1-2e47bd4d3286 req-70f4d018-98ae-449f-af49-c9a142983e17 service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-e2a98702-5b70-41a4-92f1-2e47bd4d3286 req-70f4d018-98ae-449f-af49-c9a142983e17 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] No waiting events found dispatching network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:17:22 user nova-compute[75469]: WARNING nova.compute.manager [req-e2a98702-5b70-41a4-92f1-2e47bd4d3286 req-70f4d018-98ae-449f-af49-c9a142983e17 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received unexpected event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 for instance with vm_state building and task_state spawning.
Nov 14 05:17:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:17:24 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Instance spawned successfully.
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:17:24 user nova-compute[75469]: INFO nova.compute.manager [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:17:24 user nova-compute[75469]: INFO nova.compute.manager [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Took 6.41 seconds to build instance.
Nov 14 05:17:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d871f63-b428-4736-8d8d-788affb4f63a tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.509s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-327a0cc4-5966-411e-991a-bc0b6359e213 req-0d70902c-a8ba-4fb3-a472-43cc2d744eb6 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-327a0cc4-5966-411e-991a-bc0b6359e213 req-0d70902c-a8ba-4fb3-a472-43cc2d744eb6 service nova] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-327a0cc4-5966-411e-991a-bc0b6359e213 req-0d70902c-a8ba-4fb3-a472-43cc2d744eb6 service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-327a0cc4-5966-411e-991a-bc0b6359e213 req-0d70902c-a8ba-4fb3-a472-43cc2d744eb6 service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-327a0cc4-5966-411e-991a-bc0b6359e213 req-0d70902c-a8ba-4fb3-a472-43cc2d744eb6 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] No waiting events found dispatching network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:17:24 user nova-compute[75469]: WARNING nova.compute.manager [req-327a0cc4-5966-411e-991a-bc0b6359e213 req-0d70902c-a8ba-4fb3-a472-43cc2d744eb6 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received unexpected event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 for instance with vm_state active and task_state None.
Nov 14 05:17:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG nova.compute.manager [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Going to confirm migration 2 {{(pid=75469) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquired lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG nova.network.neutron [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'info_cache' on Instance uuid a3c26481-d6c3-4480-b145-8e4d06db929a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG nova.network.neutron [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating instance_info_cache with network_info: [{"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Releasing lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'migration_context' on Instance uuid a3c26481-d6c3-4480-b145-8e4d06db929a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG nova.objects.base [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Object Instance<a3c26481-d6c3-4480-b145-8e4d06db929a> lazy-loaded attributes: info_cache,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:17:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:17:34 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:17:34 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:17:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.274s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:34 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Deleted allocation for migration cbcd2f9f-8c66-48cb-8b84-747622963de9
Nov 14 05:17:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b92f23b5-f1c3-4c33-9275-87f09b76ca3e tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.112s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:17:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:17:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:17:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:03 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:18:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:18:04 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:18:04 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:18:04 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8254MB free_disk=24.8682861328125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:18:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:18:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c4a6a311-e640-471c-9b63-39d3a32a2796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 22604611-34b5-40fa-8bda-86ddd0e0eb37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a3c26481-d6c3-4480-b145-8e4d06db929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c0455d12-633d-4dbd-86e7-9b2fd98a9e0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:18:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:18:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:18:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:18:06 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:18:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Updating instance_info_cache with network_info: [{"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:18:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-c4a6a311-e640-471c-9b63-39d3a32a2796" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:18:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:18:07 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:07 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:18:08 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:08 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:12 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-f6020ab4-91b1-4a12-a881-a943bb3ae7b2 req-42b76cc6-f4a2-4e85-b182-a2cb9776b16f service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received event network-changed-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:18:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-f6020ab4-91b1-4a12-a881-a943bb3ae7b2 req-42b76cc6-f4a2-4e85-b182-a2cb9776b16f service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Refreshing instance network info cache due to event network-changed-3d8c0cd8-8262-4a15-ace6-8f229b05172f. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:18:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f6020ab4-91b1-4a12-a881-a943bb3ae7b2 req-42b76cc6-f4a2-4e85-b182-a2cb9776b16f service nova] Acquiring lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:18:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f6020ab4-91b1-4a12-a881-a943bb3ae7b2 req-42b76cc6-f4a2-4e85-b182-a2cb9776b16f service nova] Acquired lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:18:14 user nova-compute[75469]: DEBUG nova.network.neutron [req-f6020ab4-91b1-4a12-a881-a943bb3ae7b2 req-42b76cc6-f4a2-4e85-b182-a2cb9776b16f service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Refreshing network info cache for port 3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG nova.network.neutron [req-f6020ab4-91b1-4a12-a881-a943bb3ae7b2 req-42b76cc6-f4a2-4e85-b182-a2cb9776b16f service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Updated VIF entry in instance network info cache for port 3d8c0cd8-8262-4a15-ace6-8f229b05172f. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG nova.network.neutron [req-f6020ab4-91b1-4a12-a881-a943bb3ae7b2 req-42b76cc6-f4a2-4e85-b182-a2cb9776b16f service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Updating instance_info_cache with network_info: [{"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f6020ab4-91b1-4a12-a881-a943bb3ae7b2 req-42b76cc6-f4a2-4e85-b182-a2cb9776b16f service nova] Releasing lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:18:15 user nova-compute[75469]: INFO nova.compute.manager [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Terminating instance
Nov 14 05:18:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-0ca614bb-abd6-420e-aa5b-f1ba5a00f3ff req-ccc03701-5a1f-417b-89db-bf5dd3947cd2 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received event network-vif-unplugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0ca614bb-abd6-420e-aa5b-f1ba5a00f3ff req-ccc03701-5a1f-417b-89db-bf5dd3947cd2 service nova] Acquiring lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0ca614bb-abd6-420e-aa5b-f1ba5a00f3ff req-ccc03701-5a1f-417b-89db-bf5dd3947cd2 service nova] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0ca614bb-abd6-420e-aa5b-f1ba5a00f3ff req-ccc03701-5a1f-417b-89db-bf5dd3947cd2 service nova] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-0ca614bb-abd6-420e-aa5b-f1ba5a00f3ff req-ccc03701-5a1f-417b-89db-bf5dd3947cd2 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] No waiting events found dispatching network-vif-unplugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-0ca614bb-abd6-420e-aa5b-f1ba5a00f3ff req-ccc03701-5a1f-417b-89db-bf5dd3947cd2 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received event network-vif-unplugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:16 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Instance destroyed successfully.
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.objects.instance [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'resources' on Instance uuid c0455d12-633d-4dbd-86e7-9b2fd98a9e0d {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1508294757',display_name='tempest-TestVolumeBootPattern-server-1508294757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1508294757',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfogU6kYPcp7NAmuZGDid0UKyqw1IdjLF3ZnJERaUBDZkL+xPoChg6A1IGhqjD7zf4jVDGbb4+dyNskSlHAeBsABrlV8tujEJoboi7nPt7TAeLT6Bss/BpxghYXarJuXw==',key_name='tempest-TestVolumeBootPattern-247749559',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:16:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-pb854guo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:16:33Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=c0455d12-633d-4dbd-86e7-9b2fd98a9e0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:1a:0b,bridge_name='br-int',has_traffic_filtering=True,id=3d8c0cd8-8262-4a15-ace6-8f229b05172f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8c0cd8-82') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_vif [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:1a:0b,bridge_name='br-int',has_traffic_filtering=True,id=3d8c0cd8-8262-4a15-ace6-8f229b05172f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8c0cd8-82') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d8c0cd8-82, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d9d3235-ef58-4b0e-8854-77b07b3c5479) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:16 user nova-compute[75469]: INFO os_vif [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:1a:0b,bridge_name='br-int',has_traffic_filtering=True,id=3d8c0cd8-8262-4a15-ace6-8f229b05172f,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8c0cd8-82')
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDFAKMJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:18:16 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab0cae2-31d9-448b-b7ae-93aed01467c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:18:16 user nova-compute[75469]: No targets found.
Nov 14 05:18:16 user nova-compute[75469]: iSNS:
Nov 14 05:18:16 user nova-compute[75469]: No targets found.
Nov 14 05:18:16 user nova-compute[75469]: STATIC:
Nov 14 05:18:16 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89
Nov 14 05:18:16 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:18:16 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:18:16 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf
Nov 14 05:18:16 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:18:16 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:18:16 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564
Nov 14 05:18:16 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:18:16 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:18:16 user nova-compute[75469]: FIRMWARE:
Nov 14 05:18:16 user nova-compute[75469]: No targets found.
Nov 14 05:18:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:18:16 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:18:16 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[795b6e31-0893-4489-9c28-9d0705e20048]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[15edc9b6-0eba-43ef-a4c4-a4d4f8464989]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:18:16 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:18:16 user nova-compute[75469]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 (non-flash)
Nov 14 05:18:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:18:16 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:18:16 user nova-compute[75469]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 (non-flash)
Nov 14 05:18:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c5ff1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a420e19d-0fa5-4ffb-8e06-340c60f8d08f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[969d1581-0d44-4d4a-9a42-a0002131302f]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aade844f-c2e7-4457-b39b-566ab5862b0b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c99f38-0041-4006-abb0-57b8228c4f91]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3c1898c9', '/dev/disk/by-id/scsi-1SCST_BIO3c1898c9-89ec04580a443c4f', '/dev/disk/by-id/scsi-23839656330343538') {{(pid=85531) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 05:18:16 user nova-compute[75469]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_3c1898c9
Nov 14 05:18:16 user nova-compute[75469]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO3c1898c9-89ec04580a443c4f
Nov 14 05:18:16 user nova-compute[75469]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23839656330343538
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[db65a9b4-5435-41d9-861f-1283f7ecd70c]: (4, None) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3531ad25-8717-4b6a-a0c0-32998055922d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebccdf2a-7a5d-4259-af71-448e1359cb1a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564, portal: 172.16.0.220,3260]
Nov 14 05:18:16 user nova-compute[75469]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564, portal: 172.16.0.220,3260] successful.
Nov 14 05:18:16 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88f3ae3c-cc17-49be-bbae-5295dbe82564 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[75026a72-7046-4edd-96e0-b68dda735c26]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== disconnect_volume: return (314ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:18:16 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Deleting instance files /opt/stack/data/nova/instances/c0455d12-633d-4dbd-86e7-9b2fd98a9e0d_del
Nov 14 05:18:16 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Deletion of /opt/stack/data/nova/instances/c0455d12-633d-4dbd-86e7-9b2fd98a9e0d_del complete
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-3e22318f-5549-4abd-a58e-c5eb6a371d74 req-b5bccc34-f505-4a36-a421-08a5abd6c51c service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received event network-changed-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-3e22318f-5549-4abd-a58e-c5eb6a371d74 req-b5bccc34-f505-4a36-a421-08a5abd6c51c service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Refreshing instance network info cache due to event network-changed-3d8c0cd8-8262-4a15-ace6-8f229b05172f. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3e22318f-5549-4abd-a58e-c5eb6a371d74 req-b5bccc34-f505-4a36-a421-08a5abd6c51c service nova] Acquiring lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3e22318f-5549-4abd-a58e-c5eb6a371d74 req-b5bccc34-f505-4a36-a421-08a5abd6c51c service nova] Acquired lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.network.neutron [req-3e22318f-5549-4abd-a58e-c5eb6a371d74 req-b5bccc34-f505-4a36-a421-08a5abd6c51c service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Refreshing network info cache for port 3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:18:16 user nova-compute[75469]: INFO nova.compute.manager [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 05:18:16 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:18:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-3e22318f-5549-4abd-a58e-c5eb6a371d74 req-b5bccc34-f505-4a36-a421-08a5abd6c51c service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Updated VIF entry in instance network info cache for port 3d8c0cd8-8262-4a15-ace6-8f229b05172f. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:18:17 user nova-compute[75469]: DEBUG nova.network.neutron [req-3e22318f-5549-4abd-a58e-c5eb6a371d74 req-b5bccc34-f505-4a36-a421-08a5abd6c51c service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Updating instance_info_cache with network_info: [{"id": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "address": "fa:16:3e:dc:1a:0b", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8c0cd8-82", "ovs_interfaceid": "3d8c0cd8-8262-4a15-ace6-8f229b05172f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:18:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3e22318f-5549-4abd-a58e-c5eb6a371d74 req-b5bccc34-f505-4a36-a421-08a5abd6c51c service nova] Releasing lock "refresh_cache-c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:18:17 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:18:17 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Took 0.69 seconds to deallocate network for instance.
Nov 14 05:18:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-f28ded07-6aba-4cac-bc9f-51bd8e65c602 req-9bbf010e-4ccf-4fb5-9a9a-8b803c23575c service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received event network-vif-deleted-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:18:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-81829fd3-d9d2-4852-ab42-6587d52a6222 req-b9e56ba5-ef79-40de-bb76-6df8f5321316 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received event network-vif-plugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:18:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-81829fd3-d9d2-4852-ab42-6587d52a6222 req-b9e56ba5-ef79-40de-bb76-6df8f5321316 service nova] Acquiring lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:18:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-81829fd3-d9d2-4852-ab42-6587d52a6222 req-b9e56ba5-ef79-40de-bb76-6df8f5321316 service nova] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:18:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-81829fd3-d9d2-4852-ab42-6587d52a6222 req-b9e56ba5-ef79-40de-bb76-6df8f5321316 service nova] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:18:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-81829fd3-d9d2-4852-ab42-6587d52a6222 req-b9e56ba5-ef79-40de-bb76-6df8f5321316 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] No waiting events found dispatching network-vif-plugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:18:18 user nova-compute[75469]: WARNING nova.compute.manager [req-81829fd3-d9d2-4852-ab42-6587d52a6222 req-b9e56ba5-ef79-40de-bb76-6df8f5321316 service nova] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Received unexpected event network-vif-plugged-3d8c0cd8-8262-4a15-ace6-8f229b05172f for instance with vm_state active and task_state deleting.
Nov 14 05:18:18 user nova-compute[75469]: INFO nova.compute.manager [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: c0455d12-633d-4dbd-86e7-9b2fd98a9e0d] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 05:18:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:18:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:18:18 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:18:18 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:18:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:18:18 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Deleted allocations for instance c0455d12-633d-4dbd-86e7-9b2fd98a9e0d
Nov 14 05:18:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-3cc6d8b8-1b86-4f02-a36e-ccc60df58c1d tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "c0455d12-633d-4dbd-86e7-9b2fd98a9e0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.008s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:18:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 05:18:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:23 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 05:18:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 05:18:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:18:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:18:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:18:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:18:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:06 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:19:06 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:19:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=24.859424591064453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c4a6a311-e640-471c-9b63-39d3a32a2796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 22604611-34b5-40fa-8bda-86ddd0e0eb37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a3c26481-d6c3-4480-b145-8e4d06db929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:19:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:19:07 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:19:07 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:19:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:19:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:08 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:19:08 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:19:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:19:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:19:08 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:19:08 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating instance_info_cache with network_info: [{"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:19:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-a3c26481-d6c3-4480-b145-8e4d06db929a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:19:08 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:19:08 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:19:08 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:19:08 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:19:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-29ad6fb5-f540-4637-b2ba-c29d2f743a74 req-7771f4cf-33e0-411f-9002-f64e4c2e8115 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received event network-changed-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-29ad6fb5-f540-4637-b2ba-c29d2f743a74 req-7771f4cf-33e0-411f-9002-f64e4c2e8115 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Refreshing instance network info cache due to event network-changed-889c8c86-6ec3-40a1-8761-92721c773e2a. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-29ad6fb5-f540-4637-b2ba-c29d2f743a74 req-7771f4cf-33e0-411f-9002-f64e4c2e8115 service nova] Acquiring lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-29ad6fb5-f540-4637-b2ba-c29d2f743a74 req-7771f4cf-33e0-411f-9002-f64e4c2e8115 service nova] Acquired lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.network.neutron [req-29ad6fb5-f540-4637-b2ba-c29d2f743a74 req-7771f4cf-33e0-411f-9002-f64e4c2e8115 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Refreshing network info cache for port 889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "22604611-34b5-40fa-8bda-86ddd0e0eb37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.objects.instance [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'flavor' on Instance uuid 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:19:10 user nova-compute[75469]: INFO nova.compute.manager [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Terminating instance
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:10 user nova-compute[75469]: INFO nova.compute.manager [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Attaching volume 925d949a-851a-4f81-99f5-dcc7c5fee5d2 to /dev/vdb
Nov 14 05:19:10 user nova-compute[75469]: DEBUG os_brick.utils [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9d2e69-9944-4fe9-bd46-dbbed329116e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffb54b8-5aa9-4734-8371-65a2f19b713f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-b5aebb1e-e461-4e38-9bf0-28054591f794 req-056be697-dadc-4140-8095-9acbd51cdf86 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received event network-vif-unplugged-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b5aebb1e-e461-4e38-9bf0-28054591f794 req-056be697-dadc-4140-8095-9acbd51cdf86 service nova] Acquiring lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b5aebb1e-e461-4e38-9bf0-28054591f794 req-056be697-dadc-4140-8095-9acbd51cdf86 service nova] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b5aebb1e-e461-4e38-9bf0-28054591f794 req-056be697-dadc-4140-8095-9acbd51cdf86 service nova] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-b5aebb1e-e461-4e38-9bf0-28054591f794 req-056be697-dadc-4140-8095-9acbd51cdf86 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] No waiting events found dispatching network-vif-unplugged-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-b5aebb1e-e461-4e38-9bf0-28054591f794 req-056be697-dadc-4140-8095-9acbd51cdf86 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received event network-vif-unplugged-889c8c86-6ec3-40a1-8761-92721c773e2a for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ea9a4f-a9a0-490b-9218-76de1c3ae253]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c482ded0-a374-4b68-a195-1b9f208193b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:19:10 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c20a44-679e-4da0-a787-e9a44ad60c41]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG os_brick.utils [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updating existing volume attachment record: e572829a-edd4-4362-a10a-f4226eab4fb7 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.network.neutron [req-29ad6fb5-f540-4637-b2ba-c29d2f743a74 req-7771f4cf-33e0-411f-9002-f64e4c2e8115 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Updated VIF entry in instance network info cache for port 889c8c86-6ec3-40a1-8761-92721c773e2a. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.network.neutron [req-29ad6fb5-f540-4637-b2ba-c29d2f743a74 req-7771f4cf-33e0-411f-9002-f64e4c2e8115 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Updating instance_info_cache with network_info: [{"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-29ad6fb5-f540-4637-b2ba-c29d2f743a74 req-7771f4cf-33e0-411f-9002-f64e4c2e8115 service nova] Releasing lock "refresh_cache-22604611-34b5-40fa-8bda-86ddd0e0eb37" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:10 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Instance destroyed successfully.
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lazy-loading 'resources' on Instance uuid 22604611-34b5-40fa-8bda-86ddd0e0eb37 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-295756470',display_name='tempest-TestVolumeBootPattern-server-295756470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-295756470',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfogU6kYPcp7NAmuZGDid0UKyqw1IdjLF3ZnJERaUBDZkL+xPoChg6A1IGhqjD7zf4jVDGbb4+dyNskSlHAeBsABrlV8tujEJoboi7nPt7TAeLT6Bss/BpxghYXarJuXw==',key_name='tempest-TestVolumeBootPattern-247749559',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:14:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf022cc839af44ff89e4249410c4a9e4',ramdisk_id='',reservation_id='r-5fvkz1l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-43343925',owner_user_name='tempest-TestVolumeBootPattern-43343925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:14:36Z,user_data=None,user_id='0155ca3745514d6c8c0ab08a9182df53',uuid=22604611-34b5-40fa-8bda-86ddd0e0eb37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converting VIF {"id": "889c8c86-6ec3-40a1-8761-92721c773e2a", "address": "fa:16:3e:8b:40:03", "network": {"id": "6ce8ff36-46a3-4620-bd8a-d4bf3df4f587", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2088276638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf022cc839af44ff89e4249410c4a9e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap889c8c86-6e", "ovs_interfaceid": "889c8c86-6ec3-40a1-8761-92721c773e2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:40:03,bridge_name='br-int',has_traffic_filtering=True,id=889c8c86-6ec3-40a1-8761-92721c773e2a,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889c8c86-6e') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:19:10 user nova-compute[75469]: DEBUG os_vif [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:40:03,bridge_name='br-int',has_traffic_filtering=True,id=889c8c86-6ec3-40a1-8761-92721c773e2a,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889c8c86-6e') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap889c8c86-6e, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f5405c7-f458-4cc1-9361-09065289e318) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:19:11 user nova-compute[75469]: INFO os_vif [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:40:03,bridge_name='br-int',has_traffic_filtering=True,id=889c8c86-6ec3-40a1-8761-92721c773e2a,network=Network(6ce8ff36-46a3-4620-bd8a-d4bf3df4f587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap889c8c86-6e')
Nov 14 05:19:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXvSyWTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:19:11 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[738bdf8d-c33f-41b4-a74b-ec7e29866a78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:19:11 user nova-compute[75469]: No targets found.
Nov 14 05:19:11 user nova-compute[75469]: iSNS:
Nov 14 05:19:11 user nova-compute[75469]: No targets found.
Nov 14 05:19:11 user nova-compute[75469]: STATIC:
Nov 14 05:19:11 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89
Nov 14 05:19:11 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:19:11 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:19:11 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf
Nov 14 05:19:11 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:19:11 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:19:11 user nova-compute[75469]: FIRMWARE:
Nov 14 05:19:11 user nova-compute[75469]: No targets found.
Nov 14 05:19:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:19:11 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:19:11 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60e1373-8ad2-48b7-ab27-a95d5932e190]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f57959-4a9a-4152-b66b-1a196a8368ac]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:19:11 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:19:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf (non-flash)
Nov 14 05:19:11 user nova-compute[75469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:19:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c65d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf'): ({'sdd'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Removing single pathed devices sdd {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82414887-b075-4a10-940a-bd08a59da277]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[17599b84-010d-41aa-ac01-e2d15dac5b9c]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Flushing IO for device /dev/sdd {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a79896-c849-484e-8b2a-0fe252396fc4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4d5cbb-1b5c-41b6-bcc7-ada3502e6450]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] SCSI volumes sdd have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_dc68cae6', '/dev/disk/by-id/scsi-26562333936646631', '/dev/disk/by-id/scsi-1SCST_BIOdc68cae6-eb396df137416135') {{(pid=85531) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1226d34-5e39-4bc5-8ae9-3e717c561a13]: (4, None) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3928f0eb-f847-4884-ba82-31176676f353]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e457afb-a041-4532-a820-6eef0779c564]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260]
Nov 14 05:19:11 user nova-compute[75469]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf, portal: 172.16.0.220,3260] successful.
Nov 14 05:19:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abafa81b-179e-47ae-a014-5a2c909c21cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7263d547-18ba-4f37-9476-0e2d1b90fc5f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] <== disconnect_volume: return (308ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:19:11 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Deleting instance files /opt/stack/data/nova/instances/22604611-34b5-40fa-8bda-86ddd0e0eb37_del
Nov 14 05:19:11 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Deletion of /opt/stack/data/nova/instances/22604611-34b5-40fa-8bda-86ddd0e0eb37_del complete
Nov 14 05:19:11 user nova-compute[75469]: INFO nova.compute.manager [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 05:19:11 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:19:11 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:19:11 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Took 0.47 seconds to deallocate network for instance.
Nov 14 05:19:12 user nova-compute[75469]: INFO nova.compute.manager [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 05:19:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-0002a221-422f-4ce0-8d80-70b2562f2b60 req-ebf3bf5a-084f-4acf-be4a-3aca5ab19801 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received event network-vif-plugged-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:19:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0002a221-422f-4ce0-8d80-70b2562f2b60 req-ebf3bf5a-084f-4acf-be4a-3aca5ab19801 service nova] Acquiring lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0002a221-422f-4ce0-8d80-70b2562f2b60 req-ebf3bf5a-084f-4acf-be4a-3aca5ab19801 service nova] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0002a221-422f-4ce0-8d80-70b2562f2b60 req-ebf3bf5a-084f-4acf-be4a-3aca5ab19801 service nova] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-0002a221-422f-4ce0-8d80-70b2562f2b60 req-ebf3bf5a-084f-4acf-be4a-3aca5ab19801 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] No waiting events found dispatching network-vif-plugged-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:19:12 user nova-compute[75469]: WARNING nova.compute.manager [req-0002a221-422f-4ce0-8d80-70b2562f2b60 req-ebf3bf5a-084f-4acf-be4a-3aca5ab19801 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received unexpected event network-vif-plugged-889c8c86-6ec3-40a1-8761-92721c773e2a for instance with vm_state active and task_state deleting.
Nov 14 05:19:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-0002a221-422f-4ce0-8d80-70b2562f2b60 req-ebf3bf5a-084f-4acf-be4a-3aca5ab19801 service nova] [instance: 22604611-34b5-40fa-8bda-86ddd0e0eb37] Received event network-vif-deleted-889c8c86-6ec3-40a1-8761-92721c773e2a {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:19:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:12 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:19:12 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:19:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:12 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Deleted allocations for instance 22604611-34b5-40fa-8bda-86ddd0e0eb37
Nov 14 05:19:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25cfd071-759b-4431-a32e-39fd3e8370ec tempest-TestVolumeBootPattern-43343925 tempest-TestVolumeBootPattern-43343925-project-member] Lock "22604611-34b5-40fa-8bda-86ddd0e0eb37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.766s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:19:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid d742ff9e-3b9f-4d3f-9825-3d3361765b24 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid c4a6a311-e640-471c-9b63-39d3a32a2796 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid a3c26481-d6c3-4480-b145-8e4d06db929a {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "c4a6a311-e640-471c-9b63-39d3a32a2796" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfviXmrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:19:14 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:19:14 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:19:14 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7832c5c1-9c1b-4003-9015-289a53858ec5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:19:14 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91cb19a-c9ea-43dc-9eb9-ca58a3ff5560]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2] added
Nov 14 05:19:14 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2910167-13f7-4af5-a659-5b21734eff6d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce1e5e3-7840-4990-811c-144320c9b0c0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfviXmrW {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfviXmrW" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba736996-eb5c-4d0b-b025-8b8751587cc4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfviXmrW'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6de104c-827e-43b3-b00c-9a6c026a0e44]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a21739-c7f2-4df0-9084-fcd42f849dc2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:19:14 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:19:14 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:19:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2144422d-5136-4e0b-82e1-cf124153e992]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2, portal: 172.16.0.220,3260]
Nov 14 05:19:15 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2, portal: 172.16.0.220,3260] successful.
Nov 14 05:19:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[315278bd-1597-46b1-aace-778abc8f313c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a938cd-d0d3-471d-941e-7495ad856269]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:19:15 user nova-compute[75469]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 (non-flash)
Nov 14 05:19:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:19:15 user nova-compute[75469]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 (non-flash)
Nov 14 05:19:15 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1177370a-e43c-49c1-8e1b-b9699e5ed0b7]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:19:15 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfviXmrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23231386332656433', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231386332656433', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG nova.objects.instance [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'flavor' on Instance uuid 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:19:16 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:19:16 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:19:16 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:19:16 user nova-compute[75469]:   <serial>925d949a-851a-4f81-99f5-dcc7c5fee5d2</serial>
Nov 14 05:19:16 user nova-compute[75469]: </disk>
Nov 14 05:19:16 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] No VIF found with MAC fa:16:3e:99:9c:82, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-9b8b5849-5f09-40e1-830f-7ca1073986c0 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.266s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.032s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-10852ae9-e4a2-4d7f-9af6-26d1171d9343 req-03c1e562-aec3-41f2-9859-a937031b8489 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-changed-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:19:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-10852ae9-e4a2-4d7f-9af6-26d1171d9343 req-03c1e562-aec3-41f2-9859-a937031b8489 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Refreshing instance network info cache due to event network-changed-8a528dd1-bb85-429c-9278-20c4ce221d49. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:19:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10852ae9-e4a2-4d7f-9af6-26d1171d9343 req-03c1e562-aec3-41f2-9859-a937031b8489 service nova] Acquiring lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:19:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10852ae9-e4a2-4d7f-9af6-26d1171d9343 req-03c1e562-aec3-41f2-9859-a937031b8489 service nova] Acquired lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:19:18 user nova-compute[75469]: DEBUG nova.network.neutron [req-10852ae9-e4a2-4d7f-9af6-26d1171d9343 req-03c1e562-aec3-41f2-9859-a937031b8489 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Refreshing network info cache for port 8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:19:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-10852ae9-e4a2-4d7f-9af6-26d1171d9343 req-03c1e562-aec3-41f2-9859-a937031b8489 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updated VIF entry in instance network info cache for port 8a528dd1-bb85-429c-9278-20c4ce221d49. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:19:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-10852ae9-e4a2-4d7f-9af6-26d1171d9343 req-03c1e562-aec3-41f2-9859-a937031b8489 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updating instance_info_cache with network_info: [{"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:19:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-10852ae9-e4a2-4d7f-9af6-26d1171d9343 req-03c1e562-aec3-41f2-9859-a937031b8489 service nova] Releasing lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:19:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:19:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-e1b91abb-5266-4db2-882c-6557dc349209 req-9dc5ca5f-6fae-48f0-9d43-9434a8913971 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-changed-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:19:21 user nova-compute[75469]: DEBUG nova.compute.manager [req-e1b91abb-5266-4db2-882c-6557dc349209 req-9dc5ca5f-6fae-48f0-9d43-9434a8913971 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Refreshing instance network info cache due to event network-changed-8a528dd1-bb85-429c-9278-20c4ce221d49. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:19:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e1b91abb-5266-4db2-882c-6557dc349209 req-9dc5ca5f-6fae-48f0-9d43-9434a8913971 service nova] Acquiring lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:19:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e1b91abb-5266-4db2-882c-6557dc349209 req-9dc5ca5f-6fae-48f0-9d43-9434a8913971 service nova] Acquired lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:19:21 user nova-compute[75469]: DEBUG nova.network.neutron [req-e1b91abb-5266-4db2-882c-6557dc349209 req-9dc5ca5f-6fae-48f0-9d43-9434a8913971 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Refreshing network info cache for port 8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:19:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:22 user nova-compute[75469]: INFO nova.compute.manager [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Rebooting instance
Nov 14 05:19:22 user nova-compute[75469]: DEBUG nova.network.neutron [req-e1b91abb-5266-4db2-882c-6557dc349209 req-9dc5ca5f-6fae-48f0-9d43-9434a8913971 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updated VIF entry in instance network info cache for port 8a528dd1-bb85-429c-9278-20c4ce221d49. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:19:22 user nova-compute[75469]: DEBUG nova.network.neutron [req-e1b91abb-5266-4db2-882c-6557dc349209 req-9dc5ca5f-6fae-48f0-9d43-9434a8913971 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updating instance_info_cache with network_info: [{"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:19:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e1b91abb-5266-4db2-882c-6557dc349209 req-9dc5ca5f-6fae-48f0-9d43-9434a8913971 service nova] Releasing lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:19:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:19:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquired lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:19:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:19:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updating instance_info_cache with network_info: [{"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:19:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Releasing lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:19:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:19:24 user nova-compute[75469]: INFO nova.compute.manager [None req-a3a410a1-96ff-4289-a481-3dc6dd0de16b tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Get console output
Nov 14 05:19:24 user nova-compute[75469]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 05:19:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-b00afb86-feb2-4bc2-bf18-f1a1a3cfe377 req-c26995c3-dc99-45b8-ae63-df1250da5287 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-vif-unplugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:19:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b00afb86-feb2-4bc2-bf18-f1a1a3cfe377 req-c26995c3-dc99-45b8-ae63-df1250da5287 service nova] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b00afb86-feb2-4bc2-bf18-f1a1a3cfe377 req-c26995c3-dc99-45b8-ae63-df1250da5287 service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b00afb86-feb2-4bc2-bf18-f1a1a3cfe377 req-c26995c3-dc99-45b8-ae63-df1250da5287 service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-b00afb86-feb2-4bc2-bf18-f1a1a3cfe377 req-c26995c3-dc99-45b8-ae63-df1250da5287 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] No waiting events found dispatching network-vif-unplugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:19:25 user nova-compute[75469]: WARNING nova.compute.manager [req-b00afb86-feb2-4bc2-bf18-f1a1a3cfe377 req-c26995c3-dc99-45b8-ae63-df1250da5287 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received unexpected event network-vif-unplugged-8a528dd1-bb85-429c-9278-20c4ce221d49 for instance with vm_state active and task_state reboot_started.
Nov 14 05:19:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:25 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Instance shutdown successfully.
Nov 14 05:19:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-f71967b1-bd35-4dc1-bd4c-0efd640945f3 req-060933be-5966-465c-a227-77c8cc75e812 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:19:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f71967b1-bd35-4dc1-bd4c-0efd640945f3 req-060933be-5966-465c-a227-77c8cc75e812 service nova] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f71967b1-bd35-4dc1-bd4c-0efd640945f3 req-060933be-5966-465c-a227-77c8cc75e812 service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f71967b1-bd35-4dc1-bd4c-0efd640945f3 req-060933be-5966-465c-a227-77c8cc75e812 service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-f71967b1-bd35-4dc1-bd4c-0efd640945f3 req-060933be-5966-465c-a227-77c8cc75e812 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] No waiting events found dispatching network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:19:27 user nova-compute[75469]: WARNING nova.compute.manager [req-f71967b1-bd35-4dc1-bd4c-0efd640945f3 req-060933be-5966-465c-a227-77c8cc75e812 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received unexpected event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 for instance with vm_state active and task_state reboot_started.
Nov 14 05:19:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:29 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Instance running successfully.
Nov 14 05:19:29 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Instance soft rebooted successfully.
Nov 14 05:19:29 user nova-compute[75469]: DEBUG nova.compute.manager [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:19:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:19:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] No waiting events found dispatching network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:19:29 user nova-compute[75469]: WARNING nova.compute.manager [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received unexpected event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 for instance with vm_state active and task_state reboot_started.
Nov 14 05:19:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:19:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:19:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:19:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] No waiting events found dispatching network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:19:29 user nova-compute[75469]: WARNING nova.compute.manager [req-edbea19f-38b8-4819-84b9-e310430fc674 req-bbbb243b-4455-4e9a-9f94-b973edfd47eb service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received unexpected event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 for instance with vm_state active and task_state reboot_started.
Nov 14 05:19:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-7a667c7b-4f14-4518-b616-0e08df36dbff tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.166s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:19:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:19:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:19:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:07 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:20:07 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:20:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8554MB free_disk=24.856586456298828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c4a6a311-e640-471c-9b63-39d3a32a2796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance a3c26481-d6c3-4480-b145-8e4d06db929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:20:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:20:08 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:20:08 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:20:08 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:20:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:20:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:20:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:20:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 05:20:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:20:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:20:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:20:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:20:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:20:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:20:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:20:14 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:20:15 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:20:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:20:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:20:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:20:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:20:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:20:25 user nova-compute[75469]: INFO nova.compute.manager [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Terminating instance
Nov 14 05:20:25 user nova-compute[75469]: DEBUG nova.compute.manager [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-07c151cb-208d-4486-a03e-5b8aa7fb0867 req-3866e021-15a4-46fa-9172-f9c606148606 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-vif-unplugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-07c151cb-208d-4486-a03e-5b8aa7fb0867 req-3866e021-15a4-46fa-9172-f9c606148606 service nova] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-07c151cb-208d-4486-a03e-5b8aa7fb0867 req-3866e021-15a4-46fa-9172-f9c606148606 service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-07c151cb-208d-4486-a03e-5b8aa7fb0867 req-3866e021-15a4-46fa-9172-f9c606148606 service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-07c151cb-208d-4486-a03e-5b8aa7fb0867 req-3866e021-15a4-46fa-9172-f9c606148606 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] No waiting events found dispatching network-vif-unplugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG nova.compute.manager [req-07c151cb-208d-4486-a03e-5b8aa7fb0867 req-3866e021-15a4-46fa-9172-f9c606148606 service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-vif-unplugged-8db52a6a-b924-4207-8734-fb45e4091992 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:25 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Instance destroyed successfully.
Nov 14 05:20:25 user nova-compute[75469]: DEBUG nova.objects.instance [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'resources' on Instance uuid a3c26481-d6c3-4480-b145-8e4d06db929a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1514638986',display_name='tempest-ServerActionsTestOtherA-server-1514638986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1514638986',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrNma5JBatAznC0LunFsDc00r1VsCTPs0bqBhYBSNLvVRScOCFUVl5vvCUAjsb33gm8T0M5HMwN7cuhFNaAaCpsdN1cxvRi8VbjuP9vzYk0bdC0OKE726Gcl41/vQzpiA==',key_name='tempest-keypair-438915203',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-0897f8e2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=a3c26481-d6c3-4480-b145-8e4d06db929a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "8db52a6a-b924-4207-8734-fb45e4091992", "address": "fa:16:3e:da:90:e0", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db52a6a-b9", "ovs_interfaceid": "8db52a6a-b924-4207-8734-fb45e4091992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG os_vif [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8db52a6a-b9, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2319821f-8970-49e0-b810-05f883b02e99) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:20:25 user nova-compute[75469]: INFO os_vif [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:90:e0,bridge_name='br-int',has_traffic_filtering=True,id=8db52a6a-b924-4207-8734-fb45e4091992,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db52a6a-b9')
Nov 14 05:20:25 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ovfypgdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:20:25 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:20:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf863e9-431d-4223-95c7-9792140c707f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:20:25 user nova-compute[75469]: No targets found.
Nov 14 05:20:25 user nova-compute[75469]: iSNS:
Nov 14 05:20:25 user nova-compute[75469]: No targets found.
Nov 14 05:20:25 user nova-compute[75469]: STATIC:
Nov 14 05:20:25 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2
Nov 14 05:20:25 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:20:25 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:20:25 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89
Nov 14 05:20:25 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:20:25 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:20:25 user nova-compute[75469]: FIRMWARE:
Nov 14 05:20:25 user nova-compute[75469]: No targets found.
Nov 14 05:20:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:20:25 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:20:25 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.043s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec342b26-f185-4fc2-934b-1ca0148af8f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe94e9a-eb34-4f7d-8b00-2edb9cdbe533]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:20:25 user nova-compute[75469]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 (non-flash)
Nov 14 05:20:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:20:25 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 (non-flash)
Nov 14 05:20:25 user nova-compute[75469]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 (non-flash)
Nov 14 05:20:25 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75a02dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89'): ({'sdc'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Removing single pathed devices sdc {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a8fb76-c261-4a1a-a869-eb6a8db3f57a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6906a7bb-fc89-4755-b148-e68fab94cc8e]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Flushing IO for device /dev/sdc {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3ab5d9-064e-46ab-b6c0-a709285b4cb4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5861b3-14ac-4332-958d-ea1d4769f665]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] SCSI volumes sdc have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a7be2c4a', '/dev/disk/by-id/scsi-1SCST_BIOa7be2c4a-91a95bc2aba712d0', '/dev/disk/by-id/scsi-23931613935626332') {{(pid=85531) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2115ea3f-7385-4d82-ac8e-2246d8cc8bc4]: (4, None) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a50ca9c-f133-49de-bb39-210592424d78]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9229d2c-9f58-4534-a7dc-718b1254af74]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260]
Nov 14 05:20:26 user nova-compute[75469]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89, portal: 172.16.0.220,3260] successful.
Nov 14 05:20:26 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd156c13-96fa-495d-bdf2-0961539d0d89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d1d0c3-997b-4f51-a766-a479f8080580]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] <== disconnect_volume: return (327ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:20:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Deleting instance files /opt/stack/data/nova/instances/a3c26481-d6c3-4480-b145-8e4d06db929a_del
Nov 14 05:20:26 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Deletion of /opt/stack/data/nova/instances/a3c26481-d6c3-4480-b145-8e4d06db929a_del complete
Nov 14 05:20:26 user nova-compute[75469]: INFO nova.compute.manager [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 14 05:20:26 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:20:26 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:20:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-9a3802b0-961f-41cf-ba1e-518220a048b0 req-f4c24a3e-2671-43b7-b7f4-ded59011f91d service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:20:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9a3802b0-961f-41cf-ba1e-518220a048b0 req-f4c24a3e-2671-43b7-b7f4-ded59011f91d service nova] Acquiring lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:20:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9a3802b0-961f-41cf-ba1e-518220a048b0 req-f4c24a3e-2671-43b7-b7f4-ded59011f91d service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:20:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-9a3802b0-961f-41cf-ba1e-518220a048b0 req-f4c24a3e-2671-43b7-b7f4-ded59011f91d service nova] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:20:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-9a3802b0-961f-41cf-ba1e-518220a048b0 req-f4c24a3e-2671-43b7-b7f4-ded59011f91d service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] No waiting events found dispatching network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:20:27 user nova-compute[75469]: WARNING nova.compute.manager [req-9a3802b0-961f-41cf-ba1e-518220a048b0 req-f4c24a3e-2671-43b7-b7f4-ded59011f91d service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received unexpected event network-vif-plugged-8db52a6a-b924-4207-8734-fb45e4091992 for instance with vm_state active and task_state deleting.
Nov 14 05:20:27 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:20:27 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Took 1.34 seconds to deallocate network for instance.
Nov 14 05:20:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-08f0c126-fb02-4cf8-967c-9a9912ba6c45 req-1347bdfe-b3a0-4da4-a437-a959ddb5f53d service nova] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Received event network-vif-deleted-8db52a6a-b924-4207-8734-fb45e4091992 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:20:28 user nova-compute[75469]: INFO nova.compute.manager [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 05:20:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: a3c26481-d6c3-4480-b145-8e4d06db929a] Deleting volume: cd156c13-96fa-495d-bdf2-0961539d0d89 {{(pid=75469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 05:20:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:20:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:20:28 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:20:28 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:20:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:20:28 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Deleted allocations for instance a3c26481-d6c3-4480-b145-8e4d06db929a
Nov 14 05:20:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0824ddb6-ce3f-4287-8f5b-a0badceb8217 tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "a3c26481-d6c3-4480-b145-8e4d06db929a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.640s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:20:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:20:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:20:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:20:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:21:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:21:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "c4a6a311-e640-471c-9b63-39d3a32a2796" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:07 user nova-compute[75469]: INFO nova.compute.manager [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Terminating instance
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:21:07 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:21:07 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=24.85541534423828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance c4a6a311-e640-471c-9b63-39d3a32a2796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-f148c128-99eb-4e20-8c67-03df4aa96204 req-c5a17d0e-426f-4671-8a19-2b3eb45c91da service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Received event network-vif-unplugged-982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f148c128-99eb-4e20-8c67-03df4aa96204 req-c5a17d0e-426f-4671-8a19-2b3eb45c91da service nova] Acquiring lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f148c128-99eb-4e20-8c67-03df4aa96204 req-c5a17d0e-426f-4671-8a19-2b3eb45c91da service nova] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f148c128-99eb-4e20-8c67-03df4aa96204 req-c5a17d0e-426f-4671-8a19-2b3eb45c91da service nova] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-f148c128-99eb-4e20-8c67-03df4aa96204 req-c5a17d0e-426f-4671-8a19-2b3eb45c91da service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] No waiting events found dispatching network-vif-unplugged-982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-f148c128-99eb-4e20-8c67-03df4aa96204 req-c5a17d0e-426f-4671-8a19-2b3eb45c91da service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Received event network-vif-unplugged-982e8525-a8d0-45ca-848a-4aee702453bd for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:21:07 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Instance destroyed successfully.
Nov 14 05:21:08 user nova-compute[75469]: DEBUG nova.objects.instance [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lazy-loading 'resources' on Instance uuid c4a6a311-e640-471c-9b63-39d3a32a2796 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1932536143',display_name='tempest-ServersNegativeTestJSON-server-1932536143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1932536143',id=43,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:12:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39fc8e6026a4487b9288b15dee67072f',ramdisk_id='',reservation_id='r-yfwfoknd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1402505206',owner_user_name='tempest-ServersNegativeTestJSON-1402505206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:12:32Z,user_data=None,user_id='7c8bacf3e4d54f8fb27f84f87c693e11',uuid=c4a6a311-e640-471c-9b63-39d3a32a2796,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converting VIF {"id": "982e8525-a8d0-45ca-848a-4aee702453bd", "address": "fa:16:3e:10:0a:c4", "network": {"id": "1fb9ad54-a3d7-43ce-b478-74f4c419e5f3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629648573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39fc8e6026a4487b9288b15dee67072f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982e8525-a8", "ovs_interfaceid": "982e8525-a8d0-45ca-848a-4aee702453bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=982e8525-a8d0-45ca-848a-4aee702453bd,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982e8525-a8') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG os_vif [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=982e8525-a8d0-45ca-848a-4aee702453bd,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982e8525-a8') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap982e8525-a8, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92691300-b403-48a5-97fa-386b2973e9d6) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:21:08 user nova-compute[75469]: INFO os_vif [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=982e8525-a8d0-45ca-848a-4aee702453bd,network=Network(1fb9ad54-a3d7-43ce-b478-74f4c419e5f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982e8525-a8')
Nov 14 05:21:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Deleting instance files /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796_del
Nov 14 05:21:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Deletion of /opt/stack/data/nova/instances/c4a6a311-e640-471c-9b63-39d3a32a2796_del complete
Nov 14 05:21:08 user nova-compute[75469]: INFO nova.compute.manager [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 14 05:21:08 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:21:08 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:21:09 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:21:09 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Took 0.45 seconds to deallocate network for instance.
Nov 14 05:21:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:09 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:21:09 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:21:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:09 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Deleted allocations for instance c4a6a311-e640-471c-9b63-39d3a32a2796
Nov 14 05:21:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-51a57755-57ab-4edb-a170-09b0e397fb8a tempest-ServersNegativeTestJSON-1402505206 tempest-ServersNegativeTestJSON-1402505206-project-member] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.049s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-c3ad139c-c1af-4a9d-bf8b-da4256dbaa07 req-f3c29122-cffa-4289-99a6-93060fd4e42d service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Received event network-vif-plugged-982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c3ad139c-c1af-4a9d-bf8b-da4256dbaa07 req-f3c29122-cffa-4289-99a6-93060fd4e42d service nova] Acquiring lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c3ad139c-c1af-4a9d-bf8b-da4256dbaa07 req-f3c29122-cffa-4289-99a6-93060fd4e42d service nova] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c3ad139c-c1af-4a9d-bf8b-da4256dbaa07 req-f3c29122-cffa-4289-99a6-93060fd4e42d service nova] Lock "c4a6a311-e640-471c-9b63-39d3a32a2796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-c3ad139c-c1af-4a9d-bf8b-da4256dbaa07 req-f3c29122-cffa-4289-99a6-93060fd4e42d service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] No waiting events found dispatching network-vif-plugged-982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:21:10 user nova-compute[75469]: WARNING nova.compute.manager [req-c3ad139c-c1af-4a9d-bf8b-da4256dbaa07 req-f3c29122-cffa-4289-99a6-93060fd4e42d service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Received unexpected event network-vif-plugged-982e8525-a8d0-45ca-848a-4aee702453bd for instance with vm_state deleted and task_state None.
Nov 14 05:21:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-c3ad139c-c1af-4a9d-bf8b-da4256dbaa07 req-f3c29122-cffa-4289-99a6-93060fd4e42d service nova] [instance: c4a6a311-e640-471c-9b63-39d3a32a2796] Received event network-vif-deleted-982e8525-a8d0-45ca-848a-4aee702453bd {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid d742ff9e-3b9f-4d3f-9825-3d3361765b24 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updating instance_info_cache with network_info: [{"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-d742ff9e-3b9f-4d3f-9825-3d3361765b24" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:21:10 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:21:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:21:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:21:12 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:21:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-1facdbf7-0aef-4294-b0cf-fd8bb53723b8 req-3b16fb1e-c600-498d-ad45-64482962cd36 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-changed-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:21:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-1facdbf7-0aef-4294-b0cf-fd8bb53723b8 req-3b16fb1e-c600-498d-ad45-64482962cd36 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Refreshing instance network info cache due to event network-changed-8a528dd1-bb85-429c-9278-20c4ce221d49. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:21:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1facdbf7-0aef-4294-b0cf-fd8bb53723b8 req-3b16fb1e-c600-498d-ad45-64482962cd36 service nova] Acquiring lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:21:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1facdbf7-0aef-4294-b0cf-fd8bb53723b8 req-3b16fb1e-c600-498d-ad45-64482962cd36 service nova] Acquired lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:21:13 user nova-compute[75469]: DEBUG nova.network.neutron [req-1facdbf7-0aef-4294-b0cf-fd8bb53723b8 req-3b16fb1e-c600-498d-ad45-64482962cd36 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Refreshing network info cache for port 8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-e5d029e1-77f5-4fef-bd77-347d0507b4cf req-ce9fa1ad-83ba-4d57-8de1-45f6c312fe15 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-changed-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG nova.compute.manager [req-e5d029e1-77f5-4fef-bd77-347d0507b4cf req-ce9fa1ad-83ba-4d57-8de1-45f6c312fe15 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Refreshing instance network info cache due to event network-changed-8a528dd1-bb85-429c-9278-20c4ce221d49. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e5d029e1-77f5-4fef-bd77-347d0507b4cf req-ce9fa1ad-83ba-4d57-8de1-45f6c312fe15 service nova] Acquiring lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG nova.network.neutron [req-1facdbf7-0aef-4294-b0cf-fd8bb53723b8 req-3b16fb1e-c600-498d-ad45-64482962cd36 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updated VIF entry in instance network info cache for port 8a528dd1-bb85-429c-9278-20c4ce221d49. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG nova.network.neutron [req-1facdbf7-0aef-4294-b0cf-fd8bb53723b8 req-3b16fb1e-c600-498d-ad45-64482962cd36 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updating instance_info_cache with network_info: [{"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:21:14 user nova-compute[75469]: INFO nova.compute.manager [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Detaching volume 925d949a-851a-4f81-99f5-dcc7c5fee5d2
Nov 14 05:21:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1facdbf7-0aef-4294-b0cf-fd8bb53723b8 req-3b16fb1e-c600-498d-ad45-64482962cd36 service nova] Releasing lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e5d029e1-77f5-4fef-bd77-347d0507b4cf req-ce9fa1ad-83ba-4d57-8de1-45f6c312fe15 service nova] Acquired lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG nova.network.neutron [req-e5d029e1-77f5-4fef-bd77-347d0507b4cf req-ce9fa1ad-83ba-4d57-8de1-45f6c312fe15 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Refreshing network info cache for port 8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:21:14 user nova-compute[75469]: INFO nova.virt.block_device [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Attempting to driver detach volume 925d949a-851a-4f81-99f5-dcc7c5fee5d2 from mountpoint /dev/vdb
Nov 14 05:21:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Attempting to detach device vdb from instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:21:14 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:21:14 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:21:14 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:21:14 user nova-compute[75469]:   <serial>925d949a-851a-4f81-99f5-dcc7c5fee5d2</serial>
Nov 14 05:21:14 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:21:14 user nova-compute[75469]: </disk>
Nov 14 05:21:14 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:21:14 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Successfully detached device vdb from instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af from the persistent domain config.
Nov 14 05:21:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:21:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:21:14 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:21:14 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:21:14 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:21:14 user nova-compute[75469]:   <serial>925d949a-851a-4f81-99f5-dcc7c5fee5d2</serial>
Nov 14 05:21:14 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:21:14 user nova-compute[75469]: </disk>
Nov 14 05:21:14 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:21:15 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:21:15 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:21:15 user nova-compute[75469]: DEBUG nova.network.neutron [req-e5d029e1-77f5-4fef-bd77-347d0507b4cf req-ce9fa1ad-83ba-4d57-8de1-45f6c312fe15 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updated VIF entry in instance network info cache for port 8a528dd1-bb85-429c-9278-20c4ce221d49. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:21:15 user nova-compute[75469]: DEBUG nova.network.neutron [req-e5d029e1-77f5-4fef-bd77-347d0507b4cf req-ce9fa1ad-83ba-4d57-8de1-45f6c312fe15 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updating instance_info_cache with network_info: [{"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:21:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e5d029e1-77f5-4fef-bd77-347d0507b4cf req-ce9fa1ad-83ba-4d57-8de1-45f6c312fe15 service nova] Releasing lock "refresh_cache-36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:21:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:21:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:17 user nova-compute[75469]: INFO nova.compute.manager [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Terminating instance
Nov 14 05:21:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-52eba4d1-26f5-4a8e-b25c-ea9f404d1371 req-e9191a0a-487f-4820-b867-acf38a144102 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received event network-vif-unplugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-52eba4d1-26f5-4a8e-b25c-ea9f404d1371 req-e9191a0a-487f-4820-b867-acf38a144102 service nova] Acquiring lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-52eba4d1-26f5-4a8e-b25c-ea9f404d1371 req-e9191a0a-487f-4820-b867-acf38a144102 service nova] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-52eba4d1-26f5-4a8e-b25c-ea9f404d1371 req-e9191a0a-487f-4820-b867-acf38a144102 service nova] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-52eba4d1-26f5-4a8e-b25c-ea9f404d1371 req-e9191a0a-487f-4820-b867-acf38a144102 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] No waiting events found dispatching network-vif-unplugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG nova.compute.manager [req-52eba4d1-26f5-4a8e-b25c-ea9f404d1371 req-e9191a0a-487f-4820-b867-acf38a144102 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received event network-vif-unplugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:18 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Instance destroyed successfully.
Nov 14 05:21:18 user nova-compute[75469]: DEBUG nova.objects.instance [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lazy-loading 'resources' on Instance uuid d742ff9e-3b9f-4d3f-9825-3d3361765b24 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:02:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-587132441',display_name='tempest-ServerActionsTestOtherA-server-587132441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-587132441',id=27,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrNma5JBatAznC0LunFsDc00r1VsCTPs0bqBhYBSNLvVRScOCFUVl5vvCUAjsb33gm8T0M5HMwN7cuhFNaAaCpsdN1cxvRi8VbjuP9vzYk0bdC0OKE726Gcl41/vQzpiA==',key_name='tempest-keypair-438915203',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac925f78df5d4746a9bd603db3613839',ramdisk_id='',reservation_id='r-rzzuxydm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2099137527',owner_user_name='tempest-ServerActionsTestOtherA-2099137527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd54c65b8a4adbba761994474cdd9b',uuid=d742ff9e-3b9f-4d3f-9825-3d3361765b24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converting VIF {"id": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "address": "fa:16:3e:0b:77:a5", "network": {"id": "ce6bb7bb-b60c-4063-b029-8b01b938900e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519941654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac925f78df5d4746a9bd603db3613839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1df6fdf-1b", "ovs_interfaceid": "e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:77:a5,bridge_name='br-int',has_traffic_filtering=True,id=e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1df6fdf-1b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG os_vif [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:77:a5,bridge_name='br-int',has_traffic_filtering=True,id=e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1df6fdf-1b') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1df6fdf-1b, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e909fc4e-aa48-4669-b4f1-4c87b6e1133c) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:18 user nova-compute[75469]: INFO os_vif [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:77:a5,bridge_name='br-int',has_traffic_filtering=True,id=e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1,network=Network(ce6bb7bb-b60c-4063-b029-8b01b938900e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1df6fdf-1b')
Nov 14 05:21:18 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Deleting instance files /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24_del
Nov 14 05:21:18 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Deletion of /opt/stack/data/nova/instances/d742ff9e-3b9f-4d3f-9825-3d3361765b24_del complete
Nov 14 05:21:18 user nova-compute[75469]: INFO nova.compute.manager [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 14 05:21:18 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:21:18 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:21:19 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:21:19 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Took 0.69 seconds to deallocate network for instance.
Nov 14 05:21:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-e7d7742e-db44-4d17-a500-79270dfb1422 req-c216e1c6-f515-41ec-8251-756b0b7e6d00 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received event network-vif-deleted-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:21:19 user nova-compute[75469]: INFO nova.compute.manager [req-e7d7742e-db44-4d17-a500-79270dfb1422 req-c216e1c6-f515-41ec-8251-756b0b7e6d00 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Neutron deleted interface e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1; detaching it from the instance and deleting it from the info cache
Nov 14 05:21:19 user nova-compute[75469]: DEBUG nova.network.neutron [req-e7d7742e-db44-4d17-a500-79270dfb1422 req-c216e1c6-f515-41ec-8251-756b0b7e6d00 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:21:19 user nova-compute[75469]: DEBUG nova.compute.manager [req-e7d7742e-db44-4d17-a500-79270dfb1422 req-c216e1c6-f515-41ec-8251-756b0b7e6d00 service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Detach interface failed, port_id=e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1, reason: Instance d742ff9e-3b9f-4d3f-9825-3d3361765b24 could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:21:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:19 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:21:19 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:21:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:19 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Deleted allocations for instance d742ff9e-3b9f-4d3f-9825-3d3361765b24
Nov 14 05:21:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-b4a77d9c-fe9e-49d2-8b81-fdccef2e38fc tempest-ServerActionsTestOtherA-2099137527 tempest-ServerActionsTestOtherA-2099137527-project-member] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.682s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-b7d6d6b2-0f12-40f9-b40b-225e283e1dfd req-07652dc0-7e5f-4194-be91-5a670d209faf service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received event network-vif-plugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:21:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b7d6d6b2-0f12-40f9-b40b-225e283e1dfd req-07652dc0-7e5f-4194-be91-5a670d209faf service nova] Acquiring lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:21:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b7d6d6b2-0f12-40f9-b40b-225e283e1dfd req-07652dc0-7e5f-4194-be91-5a670d209faf service nova] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:21:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-b7d6d6b2-0f12-40f9-b40b-225e283e1dfd req-07652dc0-7e5f-4194-be91-5a670d209faf service nova] Lock "d742ff9e-3b9f-4d3f-9825-3d3361765b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-b7d6d6b2-0f12-40f9-b40b-225e283e1dfd req-07652dc0-7e5f-4194-be91-5a670d209faf service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] No waiting events found dispatching network-vif-plugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:21:20 user nova-compute[75469]: WARNING nova.compute.manager [req-b7d6d6b2-0f12-40f9-b40b-225e283e1dfd req-07652dc0-7e5f-4194-be91-5a670d209faf service nova] [instance: d742ff9e-3b9f-4d3f-9825-3d3361765b24] Received unexpected event network-vif-plugged-e1df6fdf-1bd2-49c4-b1c9-56c8d2554cc1 for instance with vm_state deleted and task_state None.
Nov 14 05:21:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:21:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:21:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:21:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:21:28 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:33 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:35 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af is timed out.
Nov 14 05:21:35 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Successfully detached device vdb from instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af from the live domain config.
Nov 14 05:21:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfviXmrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:21:35 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[36395d7c-2ffe-4b6a-bc46-eb0a09fd0aeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:21:35 user nova-compute[75469]: No targets found.
Nov 14 05:21:35 user nova-compute[75469]: iSNS:
Nov 14 05:21:35 user nova-compute[75469]: No targets found.
Nov 14 05:21:35 user nova-compute[75469]: STATIC:
Nov 14 05:21:35 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2
Nov 14 05:21:35 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:21:35 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:21:35 user nova-compute[75469]: FIRMWARE:
Nov 14 05:21:35 user nova-compute[75469]: No targets found.
Nov 14 05:21:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:21:35 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:21:35 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba3fbd0-0fae-40e2-ae73-f4d8770132be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5534395-4db6-4122-a992-d5585b7b045c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 (non-flash)
Nov 14 05:21:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 (non-flash)
Nov 14 05:21:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa74c2fd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f05f370-4da6-41ff-a9bd-89dbf8ea12b7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48bf801-7aa9-4716-9140-5eb0a00cdfc7]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8880fd33-2724-4ad8-867f-d6d9d9dde514]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2202f6-0b44-4325-a632-672303d7a681]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5750cd6-b5e0-4d35-99a2-173299717109]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba7784c-7644-436b-8134-dd5a45fed03e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2, portal: 172.16.0.220,3260]
Nov 14 05:21:35 user nova-compute[75469]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2, portal: 172.16.0.220,3260] successful.
Nov 14 05:21:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925d949a-851a-4f81-99f5-dcc7c5fee5d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9103fd58-ae3c-4fa2-aa8b-f534f81438ee]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] <== disconnect_volume: return (300ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:21:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:21:36 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'flavor' on Instance uuid 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:21:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8700fac3-dee0-4872-a92a-ddca5b32d4bc tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.621s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:21:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:21:43 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:21:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:21:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:21:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:21:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:21:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:53 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:21:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:21:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:06 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:22:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:22:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:06 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:06 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:22:06 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:22:06 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=24.909568786621094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:22:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:07 user nova-compute[75469]: INFO nova.compute.manager [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Terminating instance
Nov 14 05:22:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-a4a25b10-5313-41bb-afe1-ed1adeda83f1 req-824dbb0a-d8c6-4113-bf9c-7095902cf0fd service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-vif-unplugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a4a25b10-5313-41bb-afe1-ed1adeda83f1 req-824dbb0a-d8c6-4113-bf9c-7095902cf0fd service nova] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a4a25b10-5313-41bb-afe1-ed1adeda83f1 req-824dbb0a-d8c6-4113-bf9c-7095902cf0fd service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a4a25b10-5313-41bb-afe1-ed1adeda83f1 req-824dbb0a-d8c6-4113-bf9c-7095902cf0fd service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-a4a25b10-5313-41bb-afe1-ed1adeda83f1 req-824dbb0a-d8c6-4113-bf9c-7095902cf0fd service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] No waiting events found dispatching network-vif-unplugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:22:07 user nova-compute[75469]: DEBUG nova.compute.manager [req-a4a25b10-5313-41bb-afe1-ed1adeda83f1 req-824dbb0a-d8c6-4113-bf9c-7095902cf0fd service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-vif-unplugged-8a528dd1-bb85-429c-9278-20c4ce221d49 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:22:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Instance destroyed successfully.
Nov 14 05:22:08 user nova-compute[75469]: DEBUG nova.objects.instance [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lazy-loading 'resources' on Instance uuid 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-148707394',display_name='tempest-TestMinimumBasicScenario-server-148707394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-148707394',id=48,image_ref='5d0c673d-4a37-49fb-9f5c-074d4e56e818',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOTvnb1Ix79bhElB+kW+p12c+a2upNZpt3aMMLESudfuu/XKxN0v9ttwaBsJ+vT6nSSSX14CXGwgTJ2ws4N12o+6t86PK05H+3cJuHZTxtCJGbvzxqH9RSgJEzFnzPGRw==',key_name='tempest-TestMinimumBasicScenario-1719305429',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:17:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0d0f57326454312bee742d698e94a3b',ramdisk_id='',reservation_id='r-q8isql5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d0c673d-4a37-49fb-9f5c-074d4e56e818',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1786662085',owner_user_name='tempest-TestMinimumBasicScenario-1786662085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:19:29Z,user_data=None,user_id='7864a212cd5548f6a8b3d07a3e4a2d58',uuid=36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converting VIF {"id": "8a528dd1-bb85-429c-9278-20c4ce221d49", "address": "fa:16:3e:99:9c:82", "network": {"id": "9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-105878071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d0f57326454312bee742d698e94a3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a528dd1-bb", "ovs_interfaceid": "8a528dd1-bb85-429c-9278-20c4ce221d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:9c:82,bridge_name='br-int',has_traffic_filtering=True,id=8a528dd1-bb85-429c-9278-20c4ce221d49,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a528dd1-bb') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG os_vif [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:9c:82,bridge_name='br-int',has_traffic_filtering=True,id=8a528dd1-bb85-429c-9278-20c4ce221d49,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a528dd1-bb') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a528dd1-bb, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e658d07c-f342-459b-ad57-4bcdbe4a1228) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:22:08 user nova-compute[75469]: INFO os_vif [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:9c:82,bridge_name='br-int',has_traffic_filtering=True,id=8a528dd1-bb85-429c-9278-20c4ce221d49,network=Network(9159dcd0-d4d5-48f5-8c59-9d5d1a9ba605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a528dd1-bb')
Nov 14 05:22:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Deleting instance files /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af_del
Nov 14 05:22:08 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Deletion of /opt/stack/data/nova/instances/36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af_del complete
Nov 14 05:22:08 user nova-compute[75469]: INFO nova.compute.manager [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 05:22:08 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:22:08 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Took 0.53 seconds to deallocate network for instance.
Nov 14 05:22:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-3ed9bc85-a3d1-4a99-bfd3-12b060eeb99a req-52e9880a-d9c2-4516-8ecc-ba6448a8b5cd service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-vif-deleted-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:22:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:08 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Deleted allocations for instance 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af
Nov 14 05:22:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-c80b96b0-35d1-43f4-a595-3af605e36637 tempest-TestMinimumBasicScenario-1786662085 tempest-TestMinimumBasicScenario-1786662085-project-member] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.724s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-cad0bfad-56ab-4287-96ca-db5f3d3ac1db req-9e78f58b-390b-4f36-b380-867d624791a1 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:22:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cad0bfad-56ab-4287-96ca-db5f3d3ac1db req-9e78f58b-390b-4f36-b380-867d624791a1 service nova] Acquiring lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cad0bfad-56ab-4287-96ca-db5f3d3ac1db req-9e78f58b-390b-4f36-b380-867d624791a1 service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-cad0bfad-56ab-4287-96ca-db5f3d3ac1db req-9e78f58b-390b-4f36-b380-867d624791a1 service nova] Lock "36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:09 user nova-compute[75469]: DEBUG nova.compute.manager [req-cad0bfad-56ab-4287-96ca-db5f3d3ac1db req-9e78f58b-390b-4f36-b380-867d624791a1 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] No waiting events found dispatching network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:22:09 user nova-compute[75469]: WARNING nova.compute.manager [req-cad0bfad-56ab-4287-96ca-db5f3d3ac1db req-9e78f58b-390b-4f36-b380-867d624791a1 service nova] [instance: 36cdc0c8-4f89-4ac7-a7a9-ec8ee4f552af] Received unexpected event network-vif-plugged-8a528dd1-bb85-429c-9278-20c4ce221d49 for instance with vm_state deleted and task_state None.
Nov 14 05:22:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:22:11 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:22:11 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 05:22:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:22:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:22:11 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:22:12 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:22:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:22:13 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:22:15 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:22:16 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:22:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:17 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:22:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:18 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:22:20 user nova-compute[75469]: INFO nova.compute.claims [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Claim successful on node user
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:22:20 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:22:20 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Creating image(s)
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.policy [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '911ed16dc348429e878a32954ef7a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3c946ce0c4cf5830ff44cc0b1d99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.187s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:22:20 user nova-compute[75469]: INFO nova.compute.claims [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Claim successful on node user
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.205s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk 1073741824" returned: 0 in 0.057s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.194s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Successfully created port: d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:22:21 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Cannot resize image /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Ensure instance console log exists: /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.policy [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '911ed16dc348429e878a32954ef7a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3c946ce0c4cf5830ff44cc0b1d99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:22:21 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Creating image(s)
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.226s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.231s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk 1073741824" returned: 0 in 0.058s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.234s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Cannot resize image /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Ensure instance console log exists: /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Successfully created port: ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Successfully updated port: d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquired lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-7dc8303c-7c9a-4414-97bc-5eb8dd5fa81f req-8db947c2-440d-4a42-9a97-b651f3279b53 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-changed-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-7dc8303c-7c9a-4414-97bc-5eb8dd5fa81f req-8db947c2-440d-4a42-9a97-b651f3279b53 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Refreshing instance network info cache due to event network-changed-d34712dc-7f5b-4898-852a-9535d4751885. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:22:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7dc8303c-7c9a-4414-97bc-5eb8dd5fa81f req-8db947c2-440d-4a42-9a97-b651f3279b53 service nova] Acquiring lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Releasing lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Instance network_info: |[{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7dc8303c-7c9a-4414-97bc-5eb8dd5fa81f req-8db947c2-440d-4a42-9a97-b651f3279b53 service nova] Acquired lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-7dc8303c-7c9a-4414-97bc-5eb8dd5fa81f req-8db947c2-440d-4a42-9a97-b651f3279b53 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Refreshing network info cache for port d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Start _get_guest_xml network_info=[{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:22:23 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:22:23 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-977647289',display_name='tempest-ServerRescueNegativeTestJSON-server-977647289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-977647289',id=49,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-50eb08mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:22:20Z,user_data=None,user_id='911ed16dc348429e878a32954ef7a725',uuid=6d3008b2-b2ee-4a90-8fce-b134743aeb0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:64:6b,bridge_name='br-int',has_traffic_filtering=True,id=d34712dc-7f5b-4898-852a-9535d4751885,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34712dc-7f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.objects.instance [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:22:23 user nova-compute[75469]:   <uuid>6d3008b2-b2ee-4a90-8fce-b134743aeb0a</uuid>
Nov 14 05:22:23 user nova-compute[75469]:   <name>instance-00000031</name>
Nov 14 05:22:23 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:22:23 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:22:23 user nova-compute[75469]:   <metadata>
Nov 14 05:22:23 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:22:23 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:22:23 user nova-compute[75469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-977647289</nova:name>
Nov 14 05:22:23 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:22:23</nova:creationTime>
Nov 14 05:22:23 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:22:23 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:22:23 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:22:23 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:22:23 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:22:23 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:22:23 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:22:23 user nova-compute[75469]:       <nova:owner>
Nov 14 05:22:23 user nova-compute[75469]:         <nova:user uuid="911ed16dc348429e878a32954ef7a725">tempest-ServerRescueNegativeTestJSON-207944883-project-member</nova:user>
Nov 14 05:22:23 user nova-compute[75469]:         <nova:project uuid="88f3c946ce0c4cf5830ff44cc0b1d99d">tempest-ServerRescueNegativeTestJSON-207944883</nova:project>
Nov 14 05:22:23 user nova-compute[75469]:       </nova:owner>
Nov 14 05:22:23 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:22:23 user nova-compute[75469]:       <nova:ports>
Nov 14 05:22:23 user nova-compute[75469]:         <nova:port uuid="d34712dc-7f5b-4898-852a-9535d4751885">
Nov 14 05:22:23 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 05:22:23 user nova-compute[75469]:         </nova:port>
Nov 14 05:22:23 user nova-compute[75469]:       </nova:ports>
Nov 14 05:22:23 user nova-compute[75469]:     </nova:instance>
Nov 14 05:22:23 user nova-compute[75469]:   </metadata>
Nov 14 05:22:23 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:22:23 user nova-compute[75469]:     <system>
Nov 14 05:22:23 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:22:23 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:22:23 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:22:23 user nova-compute[75469]:       <entry name="serial">6d3008b2-b2ee-4a90-8fce-b134743aeb0a</entry>
Nov 14 05:22:23 user nova-compute[75469]:       <entry name="uuid">6d3008b2-b2ee-4a90-8fce-b134743aeb0a</entry>
Nov 14 05:22:23 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:22:23 user nova-compute[75469]:     </system>
Nov 14 05:22:23 user nova-compute[75469]:   </sysinfo>
Nov 14 05:22:23 user nova-compute[75469]:   <os>
Nov 14 05:22:23 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:22:23 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:22:23 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:22:23 user nova-compute[75469]:   </os>
Nov 14 05:22:23 user nova-compute[75469]:   <features>
Nov 14 05:22:23 user nova-compute[75469]:     <acpi/>
Nov 14 05:22:23 user nova-compute[75469]:     <apic/>
Nov 14 05:22:23 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:22:23 user nova-compute[75469]:   </features>
Nov 14 05:22:23 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:22:23 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:22:23 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:22:23 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:22:23 user nova-compute[75469]:   </clock>
Nov 14 05:22:23 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:22:23 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:22:23 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:22:23 user nova-compute[75469]:   </cpu>
Nov 14 05:22:23 user nova-compute[75469]:   <devices>
Nov 14 05:22:23 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:22:23 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:22:23 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk"/>
Nov 14 05:22:23 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:22:23 user nova-compute[75469]:     </disk>
Nov 14 05:22:23 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:22:23 user nova-compute[75469]:       <mac address="fa:16:3e:e2:64:6b"/>
Nov 14 05:22:23 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:22:23 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:22:23 user nova-compute[75469]:       <target dev="tapd34712dc-7f"/>
Nov 14 05:22:23 user nova-compute[75469]:     </interface>
Nov 14 05:22:23 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:22:23 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/console.log" append="off"/>
Nov 14 05:22:23 user nova-compute[75469]:     </serial>
Nov 14 05:22:23 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:22:23 user nova-compute[75469]:     <video>
Nov 14 05:22:23 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:22:23 user nova-compute[75469]:     </video>
Nov 14 05:22:23 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:22:23 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:22:23 user nova-compute[75469]:     </rng>
Nov 14 05:22:23 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:22:23 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:22:23 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:22:23 user nova-compute[75469]:     </memballoon>
Nov 14 05:22:23 user nova-compute[75469]:   </devices>
Nov 14 05:22:23 user nova-compute[75469]: </domain>
Nov 14 05:22:23 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-977647289',display_name='tempest-ServerRescueNegativeTestJSON-server-977647289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-977647289',id=49,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-50eb08mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:22:20Z,user_data=None,user_id='911ed16dc348429e878a32954ef7a725',uuid=6d3008b2-b2ee-4a90-8fce-b134743aeb0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:64:6b,bridge_name='br-int',has_traffic_filtering=True,id=d34712dc-7f5b-4898-852a-9535d4751885,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34712dc-7f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG os_vif [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:64:6b,bridge_name='br-int',has_traffic_filtering=True,id=d34712dc-7f5b-4898-852a-9535d4751885,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34712dc-7f') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e22a6ab-4d46-5f76-9dcc-b5d71545e1f6', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd34712dc-7f, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd34712dc-7f, col_values=(('qos', UUID('a8801d75-4d17-49fc-86ba-0006d5217af7')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd34712dc-7f, col_values=(('external_ids', {'iface-id': 'd34712dc-7f5b-4898-852a-9535d4751885', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:64:6b', 'vm-uuid': '6d3008b2-b2ee-4a90-8fce-b134743aeb0a'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:23 user nova-compute[75469]: INFO os_vif [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:64:6b,bridge_name='br-int',has_traffic_filtering=True,id=d34712dc-7f5b-4898-852a-9535d4751885,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34712dc-7f')
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No VIF found with MAC fa:16:3e:e2:64:6b, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Successfully updated port: ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquired lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-7dc8303c-7c9a-4414-97bc-5eb8dd5fa81f req-8db947c2-440d-4a42-9a97-b651f3279b53 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updated VIF entry in instance network info cache for port d34712dc-7f5b-4898-852a-9535d4751885. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG nova.network.neutron [req-7dc8303c-7c9a-4414-97bc-5eb8dd5fa81f req-8db947c2-440d-4a42-9a97-b651f3279b53 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:22:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7dc8303c-7c9a-4414-97bc-5eb8dd5fa81f req-8db947c2-440d-4a42-9a97-b651f3279b53 service nova] Releasing lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.network.neutron [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updating instance_info_cache with network_info: [{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Releasing lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Instance network_info: |[{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Start _get_guest_xml network_info=[{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:22:24 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:22:24 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2044441665',display_name='tempest-ServerRescueNegativeTestJSON-server-2044441665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2044441665',id=50,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-9pc161e7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:22:21Z,user_data=None,user_id='911ed16dc348429e878a32954ef7a725',uuid=2dcfec49-2eac-427a-8c3e-44b923538dcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=ab315f7a-888a-4327-b927-dc3a9c90b62b,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab315f7a-88') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.objects.instance [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dcfec49-2eac-427a-8c3e-44b923538dcb {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:22:24 user nova-compute[75469]:   <uuid>2dcfec49-2eac-427a-8c3e-44b923538dcb</uuid>
Nov 14 05:22:24 user nova-compute[75469]:   <name>instance-00000032</name>
Nov 14 05:22:24 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:22:24 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:22:24 user nova-compute[75469]:   <metadata>
Nov 14 05:22:24 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:22:24 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:22:24 user nova-compute[75469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2044441665</nova:name>
Nov 14 05:22:24 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:22:24</nova:creationTime>
Nov 14 05:22:24 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:22:24 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:22:24 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:22:24 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:22:24 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:22:24 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:22:24 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:22:24 user nova-compute[75469]:       <nova:owner>
Nov 14 05:22:24 user nova-compute[75469]:         <nova:user uuid="911ed16dc348429e878a32954ef7a725">tempest-ServerRescueNegativeTestJSON-207944883-project-member</nova:user>
Nov 14 05:22:24 user nova-compute[75469]:         <nova:project uuid="88f3c946ce0c4cf5830ff44cc0b1d99d">tempest-ServerRescueNegativeTestJSON-207944883</nova:project>
Nov 14 05:22:24 user nova-compute[75469]:       </nova:owner>
Nov 14 05:22:24 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:22:24 user nova-compute[75469]:       <nova:ports>
Nov 14 05:22:24 user nova-compute[75469]:         <nova:port uuid="ab315f7a-888a-4327-b927-dc3a9c90b62b">
Nov 14 05:22:24 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 05:22:24 user nova-compute[75469]:         </nova:port>
Nov 14 05:22:24 user nova-compute[75469]:       </nova:ports>
Nov 14 05:22:24 user nova-compute[75469]:     </nova:instance>
Nov 14 05:22:24 user nova-compute[75469]:   </metadata>
Nov 14 05:22:24 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:22:24 user nova-compute[75469]:     <system>
Nov 14 05:22:24 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:22:24 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:22:24 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:22:24 user nova-compute[75469]:       <entry name="serial">2dcfec49-2eac-427a-8c3e-44b923538dcb</entry>
Nov 14 05:22:24 user nova-compute[75469]:       <entry name="uuid">2dcfec49-2eac-427a-8c3e-44b923538dcb</entry>
Nov 14 05:22:24 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:22:24 user nova-compute[75469]:     </system>
Nov 14 05:22:24 user nova-compute[75469]:   </sysinfo>
Nov 14 05:22:24 user nova-compute[75469]:   <os>
Nov 14 05:22:24 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:22:24 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:22:24 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:22:24 user nova-compute[75469]:   </os>
Nov 14 05:22:24 user nova-compute[75469]:   <features>
Nov 14 05:22:24 user nova-compute[75469]:     <acpi/>
Nov 14 05:22:24 user nova-compute[75469]:     <apic/>
Nov 14 05:22:24 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:22:24 user nova-compute[75469]:   </features>
Nov 14 05:22:24 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:22:24 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:22:24 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:22:24 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:22:24 user nova-compute[75469]:   </clock>
Nov 14 05:22:24 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:22:24 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:22:24 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:22:24 user nova-compute[75469]:   </cpu>
Nov 14 05:22:24 user nova-compute[75469]:   <devices>
Nov 14 05:22:24 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:22:24 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:22:24 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk"/>
Nov 14 05:22:24 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:22:24 user nova-compute[75469]:     </disk>
Nov 14 05:22:24 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:22:24 user nova-compute[75469]:       <mac address="fa:16:3e:a1:b7:f7"/>
Nov 14 05:22:24 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:22:24 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:22:24 user nova-compute[75469]:       <target dev="tapab315f7a-88"/>
Nov 14 05:22:24 user nova-compute[75469]:     </interface>
Nov 14 05:22:24 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:22:24 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/console.log" append="off"/>
Nov 14 05:22:24 user nova-compute[75469]:     </serial>
Nov 14 05:22:24 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:22:24 user nova-compute[75469]:     <video>
Nov 14 05:22:24 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:22:24 user nova-compute[75469]:     </video>
Nov 14 05:22:24 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:22:24 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:22:24 user nova-compute[75469]:     </rng>
Nov 14 05:22:24 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:22:24 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:22:24 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:22:24 user nova-compute[75469]:     </memballoon>
Nov 14 05:22:24 user nova-compute[75469]:   </devices>
Nov 14 05:22:24 user nova-compute[75469]: </domain>
Nov 14 05:22:24 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2044441665',display_name='tempest-ServerRescueNegativeTestJSON-server-2044441665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2044441665',id=50,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-9pc161e7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:22:21Z,user_data=None,user_id='911ed16dc348429e878a32954ef7a725',uuid=2dcfec49-2eac-427a-8c3e-44b923538dcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=ab315f7a-888a-4327-b927-dc3a9c90b62b,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab315f7a-88') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG os_vif [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=ab315f7a-888a-4327-b927-dc3a9c90b62b,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab315f7a-88') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fad4ec8d-0292-58a7-be6e-467bb2dbdec0', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab315f7a-88, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab315f7a-88, col_values=(('qos', UUID('ff5154d1-3052-4bcc-8998-a11d7c74f842')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab315f7a-88, col_values=(('external_ids', {'iface-id': 'ab315f7a-888a-4327-b927-dc3a9c90b62b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:b7:f7', 'vm-uuid': '2dcfec49-2eac-427a-8c3e-44b923538dcb'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:24 user nova-compute[75469]: INFO os_vif [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=ab315f7a-888a-4327-b927-dc3a9c90b62b,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab315f7a-88')
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No VIF found with MAC fa:16:3e:a1:b7:f7, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-143c439a-38b2-42d5-a9d1-3842f08d6ad9 req-6fe33629-208d-499f-afec-9c8aeb6fc133 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received event network-changed-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.compute.manager [req-143c439a-38b2-42d5-a9d1-3842f08d6ad9 req-6fe33629-208d-499f-afec-9c8aeb6fc133 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Refreshing instance network info cache due to event network-changed-ab315f7a-888a-4327-b927-dc3a9c90b62b. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-143c439a-38b2-42d5-a9d1-3842f08d6ad9 req-6fe33629-208d-499f-afec-9c8aeb6fc133 service nova] Acquiring lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-143c439a-38b2-42d5-a9d1-3842f08d6ad9 req-6fe33629-208d-499f-afec-9c8aeb6fc133 service nova] Acquired lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:22:24 user nova-compute[75469]: DEBUG nova.network.neutron [req-143c439a-38b2-42d5-a9d1-3842f08d6ad9 req-6fe33629-208d-499f-afec-9c8aeb6fc133 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Refreshing network info cache for port ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:22:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-143c439a-38b2-42d5-a9d1-3842f08d6ad9 req-6fe33629-208d-499f-afec-9c8aeb6fc133 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updated VIF entry in instance network info cache for port ab315f7a-888a-4327-b927-dc3a9c90b62b. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG nova.network.neutron [req-143c439a-38b2-42d5-a9d1-3842f08d6ad9 req-6fe33629-208d-499f-afec-9c8aeb6fc133 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updating instance_info_cache with network_info: [{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-143c439a-38b2-42d5-a9d1-3842f08d6ad9 req-6fe33629-208d-499f-afec-9c8aeb6fc133 service nova] Releasing lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-a302e88e-94ac-4183-a776-48babeeda0f0 req-d24a377c-6661-4d5f-95f0-8a0b93c2ae27 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a302e88e-94ac-4183-a776-48babeeda0f0 req-d24a377c-6661-4d5f-95f0-8a0b93c2ae27 service nova] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a302e88e-94ac-4183-a776-48babeeda0f0 req-d24a377c-6661-4d5f-95f0-8a0b93c2ae27 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a302e88e-94ac-4183-a776-48babeeda0f0 req-d24a377c-6661-4d5f-95f0-8a0b93c2ae27 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG nova.compute.manager [req-a302e88e-94ac-4183-a776-48babeeda0f0 req-d24a377c-6661-4d5f-95f0-8a0b93c2ae27 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] No waiting events found dispatching network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:22:26 user nova-compute[75469]: WARNING nova.compute.manager [req-a302e88e-94ac-4183-a776-48babeeda0f0 req-d24a377c-6661-4d5f-95f0-8a0b93c2ae27 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received unexpected event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b for instance with vm_state building and task_state spawning.
Nov 14 05:22:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:22:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:22:27 user nova-compute[75469]: WARNING nova.compute.manager [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received unexpected event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with vm_state building and task_state spawning.
Nov 14 05:22:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:22:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:27 user nova-compute[75469]: DEBUG nova.compute.manager [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:22:27 user nova-compute[75469]: WARNING nova.compute.manager [req-0cb1fc74-a78d-4fce-8f95-e548c47f285f req-1ac0da0a-2c8b-4e53-a603-387d53bc9ead service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received unexpected event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with vm_state building and task_state spawning.
Nov 14 05:22:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:22:28 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Instance spawned successfully.
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: INFO nova.compute.manager [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Took 7.94 seconds to spawn the instance on the hypervisor.
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:22:28 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Instance spawned successfully.
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:22:28 user nova-compute[75469]: INFO nova.compute.manager [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Took 8.49 seconds to build instance.
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.compute.manager [req-fa77f5fc-9530-4137-be1a-a966ff22a8fb req-52cfd018-b51c-42ad-8a37-519fb01295e6 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fa77f5fc-9530-4137-be1a-a966ff22a8fb req-52cfd018-b51c-42ad-8a37-519fb01295e6 service nova] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fa77f5fc-9530-4137-be1a-a966ff22a8fb req-52cfd018-b51c-42ad-8a37-519fb01295e6 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fa77f5fc-9530-4137-be1a-a966ff22a8fb req-52cfd018-b51c-42ad-8a37-519fb01295e6 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.compute.manager [req-fa77f5fc-9530-4137-be1a-a966ff22a8fb req-52cfd018-b51c-42ad-8a37-519fb01295e6 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] No waiting events found dispatching network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:22:28 user nova-compute[75469]: WARNING nova.compute.manager [req-fa77f5fc-9530-4137-be1a-a966ff22a8fb req-52cfd018-b51c-42ad-8a37-519fb01295e6 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received unexpected event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b for instance with vm_state building and task_state spawning.
Nov 14 05:22:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-6d7416c4-ec2b-4f5d-a48b-f0bf1612a1eb tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.649s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:28 user nova-compute[75469]: INFO nova.compute.manager [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 14 05:22:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:22:28 user nova-compute[75469]: INFO nova.compute.manager [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Took 7.84 seconds to build instance.
Nov 14 05:22:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d369a55e-265e-46ac-a1c9-8f12cfc0ca3b tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.994s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:22:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:22:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:03 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:23:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:09 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:23:09 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=24.908218383789062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:23:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:23:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:11 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:23:11 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:23:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:23:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:23:11 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:23:11 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:23:12 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:23:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:23:12 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:23:12 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:23:14 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:23:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:23:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:15 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:17 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:18 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:23:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:23:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:23:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:23:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:27 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:23:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:23:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:32 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 05:23:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 05:23:32 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:23:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 05:23:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:23:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:23:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:23:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:23:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:23:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:23:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:23:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:23:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:23:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:23:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:24:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:24:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:24:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:24:10 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:24:10 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:24:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=24.907428741455078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:24:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:24:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:24:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:24:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:24:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:24:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:24:10 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:24:10 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:24:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:24:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:24:11 user nova-compute[75469]: INFO nova.compute.manager [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Rescuing
Nov 14 05:24:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquired lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG nova.network.neutron [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updating instance_info_cache with network_info: [{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Releasing lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-fe6f2ecf-309c-4bc6-8b9f-ff5bacc7efc0 req-02225a53-aa0c-4492-98ae-612a59578008 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received event network-vif-unplugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fe6f2ecf-309c-4bc6-8b9f-ff5bacc7efc0 req-02225a53-aa0c-4492-98ae-612a59578008 service nova] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fe6f2ecf-309c-4bc6-8b9f-ff5bacc7efc0 req-02225a53-aa0c-4492-98ae-612a59578008 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fe6f2ecf-309c-4bc6-8b9f-ff5bacc7efc0 req-02225a53-aa0c-4492-98ae-612a59578008 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG nova.compute.manager [req-fe6f2ecf-309c-4bc6-8b9f-ff5bacc7efc0 req-02225a53-aa0c-4492-98ae-612a59578008 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] No waiting events found dispatching network-vif-unplugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:24:11 user nova-compute[75469]: WARNING nova.compute.manager [req-fe6f2ecf-309c-4bc6-8b9f-ff5bacc7efc0 req-02225a53-aa0c-4492-98ae-612a59578008 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received unexpected event network-vif-unplugged-ab315f7a-888a-4327-b927-dc3a9c90b62b for instance with vm_state active and task_state rescuing.
Nov 14 05:24:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Instance destroyed successfully.
Nov 14 05:24:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Attempting rescue
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Instance directory exists: not creating {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 05:24:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Creating image(s)
Nov 14 05:24:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2dcfec49-2eac-427a-8c3e-44b923538dcb {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue" returned: 0 in 0.057s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'migration_context' on Instance uuid 2dcfec49-2eac-427a-8c3e-44b923538dcb {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.objects.base [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<2dcfec49-2eac-427a-8c3e-44b923538dcb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Start _get_guest_xml network_info=[{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "vif_mac": "fa:16:3e:a1:b7:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'resources' on Instance uuid 2dcfec49-2eac-427a-8c3e-44b923538dcb {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.objects.base [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<2dcfec49-2eac-427a-8c3e-44b923538dcb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'numa_topology' on Instance uuid 2dcfec49-2eac-427a-8c3e-44b923538dcb {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.objects.base [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<2dcfec49-2eac-427a-8c3e-44b923538dcb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:24:12 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:24:12 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2dcfec49-2eac-427a-8c3e-44b923538dcb {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.objects.base [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<2dcfec49-2eac-427a-8c3e-44b923538dcb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2044441665',display_name='tempest-ServerRescueNegativeTestJSON-server-2044441665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2044441665',id=50,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-9pc161e7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:22:29Z,user_data=None,user_id='911ed16dc348429e878a32954ef7a725',uuid=2dcfec49-2eac-427a-8c3e-44b923538dcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "vif_mac": "fa:16:3e:a1:b7:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "vif_mac": "fa:16:3e:a1:b7:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=ab315f7a-888a-4327-b927-dc3a9c90b62b,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab315f7a-88') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dcfec49-2eac-427a-8c3e-44b923538dcb {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.objects.base [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<2dcfec49-2eac-427a-8c3e-44b923538dcb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:24:12 user nova-compute[75469]:   <uuid>2dcfec49-2eac-427a-8c3e-44b923538dcb</uuid>
Nov 14 05:24:12 user nova-compute[75469]:   <name>instance-00000032</name>
Nov 14 05:24:12 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:24:12 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:24:12 user nova-compute[75469]:   <metadata>
Nov 14 05:24:12 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:24:12 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:24:12 user nova-compute[75469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2044441665</nova:name>
Nov 14 05:24:12 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:24:12</nova:creationTime>
Nov 14 05:24:12 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:24:12 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:24:12 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:24:12 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:24:12 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:24:12 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:24:12 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:24:12 user nova-compute[75469]:       <nova:owner>
Nov 14 05:24:12 user nova-compute[75469]:         <nova:user uuid="911ed16dc348429e878a32954ef7a725">tempest-ServerRescueNegativeTestJSON-207944883-project-member</nova:user>
Nov 14 05:24:12 user nova-compute[75469]:         <nova:project uuid="88f3c946ce0c4cf5830ff44cc0b1d99d">tempest-ServerRescueNegativeTestJSON-207944883</nova:project>
Nov 14 05:24:12 user nova-compute[75469]:       </nova:owner>
Nov 14 05:24:12 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:24:12 user nova-compute[75469]:       <nova:ports>
Nov 14 05:24:12 user nova-compute[75469]:         <nova:port uuid="ab315f7a-888a-4327-b927-dc3a9c90b62b">
Nov 14 05:24:12 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 05:24:12 user nova-compute[75469]:         </nova:port>
Nov 14 05:24:12 user nova-compute[75469]:       </nova:ports>
Nov 14 05:24:12 user nova-compute[75469]:     </nova:instance>
Nov 14 05:24:12 user nova-compute[75469]:   </metadata>
Nov 14 05:24:12 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:24:12 user nova-compute[75469]:     <system>
Nov 14 05:24:12 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:24:12 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:24:12 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:24:12 user nova-compute[75469]:       <entry name="serial">2dcfec49-2eac-427a-8c3e-44b923538dcb</entry>
Nov 14 05:24:12 user nova-compute[75469]:       <entry name="uuid">2dcfec49-2eac-427a-8c3e-44b923538dcb</entry>
Nov 14 05:24:12 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:24:12 user nova-compute[75469]:     </system>
Nov 14 05:24:12 user nova-compute[75469]:   </sysinfo>
Nov 14 05:24:12 user nova-compute[75469]:   <os>
Nov 14 05:24:12 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:24:12 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:24:12 user nova-compute[75469]:   </os>
Nov 14 05:24:12 user nova-compute[75469]:   <features>
Nov 14 05:24:12 user nova-compute[75469]:     <acpi/>
Nov 14 05:24:12 user nova-compute[75469]:     <apic/>
Nov 14 05:24:12 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:24:12 user nova-compute[75469]:   </features>
Nov 14 05:24:12 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:24:12 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:24:12 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:24:12 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:24:12 user nova-compute[75469]:   </clock>
Nov 14 05:24:12 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:24:12 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:24:12 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:24:12 user nova-compute[75469]:   </cpu>
Nov 14 05:24:12 user nova-compute[75469]:   <devices>
Nov 14 05:24:12 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:24:12 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:24:12 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue"/>
Nov 14 05:24:12 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:24:12 user nova-compute[75469]:     </disk>
Nov 14 05:24:12 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:24:12 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:24:12 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk"/>
Nov 14 05:24:12 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 05:24:12 user nova-compute[75469]:     </disk>
Nov 14 05:24:12 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:24:12 user nova-compute[75469]:       <mac address="fa:16:3e:a1:b7:f7"/>
Nov 14 05:24:12 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:24:12 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:24:12 user nova-compute[75469]:       <target dev="tapab315f7a-88"/>
Nov 14 05:24:12 user nova-compute[75469]:     </interface>
Nov 14 05:24:12 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:24:12 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/console.log" append="off"/>
Nov 14 05:24:12 user nova-compute[75469]:     </serial>
Nov 14 05:24:12 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:24:12 user nova-compute[75469]:     <video>
Nov 14 05:24:12 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:24:12 user nova-compute[75469]:     </video>
Nov 14 05:24:12 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:24:12 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:24:12 user nova-compute[75469]:     </rng>
Nov 14 05:24:12 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:24:12 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:24:12 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:24:12 user nova-compute[75469]:     </memballoon>
Nov 14 05:24:12 user nova-compute[75469]:   </devices>
Nov 14 05:24:12 user nova-compute[75469]: </domain>
Nov 14 05:24:12 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:24:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Instance destroyed successfully.
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:24:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No VIF found with MAC fa:16:3e:a1:b7:f7, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:24:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:24:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:24:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:24:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:24:13 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:24:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-48daa289-f081-4ca1-83a7-e8db42ede0bd req-097d76e6-b1c4-47a6-8e4f-af57ee9fae72 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:24:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-48daa289-f081-4ca1-83a7-e8db42ede0bd req-097d76e6-b1c4-47a6-8e4f-af57ee9fae72 service nova] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:24:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-48daa289-f081-4ca1-83a7-e8db42ede0bd req-097d76e6-b1c4-47a6-8e4f-af57ee9fae72 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:24:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-48daa289-f081-4ca1-83a7-e8db42ede0bd req-097d76e6-b1c4-47a6-8e4f-af57ee9fae72 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:24:13 user nova-compute[75469]: DEBUG nova.compute.manager [req-48daa289-f081-4ca1-83a7-e8db42ede0bd req-097d76e6-b1c4-47a6-8e4f-af57ee9fae72 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] No waiting events found dispatching network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:24:13 user nova-compute[75469]: WARNING nova.compute.manager [req-48daa289-f081-4ca1-83a7-e8db42ede0bd req-097d76e6-b1c4-47a6-8e4f-af57ee9fae72 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received unexpected event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b for instance with vm_state active and task_state rescuing.
Nov 14 05:24:14 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updating instance_info_cache with network_info: [{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:24:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:24:14 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:24:14 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:24:14 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:24:14 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:24:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:15 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:24:15 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:24:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:24:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:24:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:24:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:24:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] No waiting events found dispatching network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:24:16 user nova-compute[75469]: WARNING nova.compute.manager [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received unexpected event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b for instance with vm_state active and task_state rescuing.
Nov 14 05:24:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:24:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:24:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:24:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:24:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] No waiting events found dispatching network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:24:16 user nova-compute[75469]: WARNING nova.compute.manager [req-0c6ec9ef-50f3-4ff9-99d4-8e987fc515dd req-e192c799-ead7-45fd-9870-ffabed205d31 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received unexpected event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b for instance with vm_state active and task_state rescuing.
Nov 14 05:24:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-e8e01a29-fb7f-4e95-8b6c-139603143979 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:24:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:17 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:24:17 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:24:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:24:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:24:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:24:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:24:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:24:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:24:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:24:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:25:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:25:09 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:25:10 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:25:10 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:25:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=24.905807495117188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:25:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:25:13 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:25:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:25:13 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:25:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:25:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:25:13 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:25:13 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:25:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:25:15 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:25:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:25:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:25:15 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:25:15 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:25:15 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:25:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:25:16 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:25:18 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:25:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:25:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:25:20 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:25:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:25:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:25:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:25:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:25:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:25:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:25:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:25:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:26:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:26:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:26:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:26:11 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:26:11 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:26:11 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=24.905261993408203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:26:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:26:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:26:14 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:26:14 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:26:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:26:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:26:15 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:26:15 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updating instance_info_cache with network_info: [{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:26:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:26:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:26:15 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:26:17 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:26:17 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:26:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:26:18 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:26:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:26:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:26:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:26:21 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:26:22 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:26:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:26:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:26:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:26:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:26:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:26:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:26:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:26:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:03 user nova-compute[75469]: INFO nova.compute.manager [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Rescuing
Nov 14 05:27:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:27:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquired lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:27:03 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:27:03 user nova-compute[75469]: DEBUG nova.network.neutron [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:27:03 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Releasing lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-2e5c95c4-1001-4aec-9000-3321ea11c27e req-cf35718e-835d-4db2-b588-75c062748138 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-unplugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2e5c95c4-1001-4aec-9000-3321ea11c27e req-cf35718e-835d-4db2-b588-75c062748138 service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2e5c95c4-1001-4aec-9000-3321ea11c27e req-cf35718e-835d-4db2-b588-75c062748138 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2e5c95c4-1001-4aec-9000-3321ea11c27e req-cf35718e-835d-4db2-b588-75c062748138 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-2e5c95c4-1001-4aec-9000-3321ea11c27e req-cf35718e-835d-4db2-b588-75c062748138 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-unplugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:27:04 user nova-compute[75469]: WARNING nova.compute.manager [req-2e5c95c4-1001-4aec-9000-3321ea11c27e req-cf35718e-835d-4db2-b588-75c062748138 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received unexpected event network-vif-unplugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with vm_state active and task_state rescuing.
Nov 14 05:27:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Instance destroyed successfully.
Nov 14 05:27:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Attempting rescue
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Instance directory exists: not creating {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 05:27:04 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Creating image(s)
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.232s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.rescue {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.rescue" returned: 0 in 0.047s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'migration_context' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.objects.base [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<6d3008b2-b2ee-4a90-8fce-b134743aeb0a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Start _get_guest_xml network_info=[{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "vif_mac": "fa:16:3e:e2:64:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'resources' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.objects.base [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<6d3008b2-b2ee-4a90-8fce-b134743aeb0a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'numa_topology' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.objects.base [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<6d3008b2-b2ee-4a90-8fce-b134743aeb0a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:27:04 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:27:04 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:27:04 user nova-compute[75469]: DEBUG nova.objects.base [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<6d3008b2-b2ee-4a90-8fce-b134743aeb0a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:27:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-977647289',display_name='tempest-ServerRescueNegativeTestJSON-server-977647289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-977647289',id=49,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-50eb08mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:22:29Z,user_data=None,user_id='911ed16dc348429e878a32954ef7a725',uuid=6d3008b2-b2ee-4a90-8fce-b134743aeb0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "vif_mac": "fa:16:3e:e2:64:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:27:05 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "vif_mac": "fa:16:3e:e2:64:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:27:05 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:64:6b,bridge_name='br-int',has_traffic_filtering=True,id=d34712dc-7f5b-4898-852a-9535d4751885,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34712dc-7f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:27:05 user nova-compute[75469]: DEBUG nova.objects.instance [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:27:05 user nova-compute[75469]: DEBUG nova.objects.base [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<6d3008b2-b2ee-4a90-8fce-b134743aeb0a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:27:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:27:05 user nova-compute[75469]:   <uuid>6d3008b2-b2ee-4a90-8fce-b134743aeb0a</uuid>
Nov 14 05:27:05 user nova-compute[75469]:   <name>instance-00000031</name>
Nov 14 05:27:05 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:27:05 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:27:05 user nova-compute[75469]:   <metadata>
Nov 14 05:27:05 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:27:05 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:27:05 user nova-compute[75469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-977647289</nova:name>
Nov 14 05:27:05 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:27:04</nova:creationTime>
Nov 14 05:27:05 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:27:05 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:27:05 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:27:05 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:27:05 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:27:05 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:27:05 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:27:05 user nova-compute[75469]:       <nova:owner>
Nov 14 05:27:05 user nova-compute[75469]:         <nova:user uuid="911ed16dc348429e878a32954ef7a725">tempest-ServerRescueNegativeTestJSON-207944883-project-member</nova:user>
Nov 14 05:27:05 user nova-compute[75469]:         <nova:project uuid="88f3c946ce0c4cf5830ff44cc0b1d99d">tempest-ServerRescueNegativeTestJSON-207944883</nova:project>
Nov 14 05:27:05 user nova-compute[75469]:       </nova:owner>
Nov 14 05:27:05 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:27:05 user nova-compute[75469]:       <nova:ports>
Nov 14 05:27:05 user nova-compute[75469]:         <nova:port uuid="d34712dc-7f5b-4898-852a-9535d4751885">
Nov 14 05:27:05 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 05:27:05 user nova-compute[75469]:         </nova:port>
Nov 14 05:27:05 user nova-compute[75469]:       </nova:ports>
Nov 14 05:27:05 user nova-compute[75469]:     </nova:instance>
Nov 14 05:27:05 user nova-compute[75469]:   </metadata>
Nov 14 05:27:05 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:27:05 user nova-compute[75469]:     <system>
Nov 14 05:27:05 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:27:05 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:27:05 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:27:05 user nova-compute[75469]:       <entry name="serial">6d3008b2-b2ee-4a90-8fce-b134743aeb0a</entry>
Nov 14 05:27:05 user nova-compute[75469]:       <entry name="uuid">6d3008b2-b2ee-4a90-8fce-b134743aeb0a</entry>
Nov 14 05:27:05 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:27:05 user nova-compute[75469]:     </system>
Nov 14 05:27:05 user nova-compute[75469]:   </sysinfo>
Nov 14 05:27:05 user nova-compute[75469]:   <os>
Nov 14 05:27:05 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:27:05 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:27:05 user nova-compute[75469]:   </os>
Nov 14 05:27:05 user nova-compute[75469]:   <features>
Nov 14 05:27:05 user nova-compute[75469]:     <acpi/>
Nov 14 05:27:05 user nova-compute[75469]:     <apic/>
Nov 14 05:27:05 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:27:05 user nova-compute[75469]:   </features>
Nov 14 05:27:05 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:27:05 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:27:05 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:27:05 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:27:05 user nova-compute[75469]:   </clock>
Nov 14 05:27:05 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:27:05 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:27:05 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:27:05 user nova-compute[75469]:   </cpu>
Nov 14 05:27:05 user nova-compute[75469]:   <devices>
Nov 14 05:27:05 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:27:05 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:27:05 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.rescue"/>
Nov 14 05:27:05 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:27:05 user nova-compute[75469]:     </disk>
Nov 14 05:27:05 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:27:05 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:27:05 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk"/>
Nov 14 05:27:05 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 05:27:05 user nova-compute[75469]:     </disk>
Nov 14 05:27:05 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:27:05 user nova-compute[75469]:       <mac address="fa:16:3e:e2:64:6b"/>
Nov 14 05:27:05 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:27:05 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:27:05 user nova-compute[75469]:       <target dev="tapd34712dc-7f"/>
Nov 14 05:27:05 user nova-compute[75469]:     </interface>
Nov 14 05:27:05 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:27:05 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/console.log" append="off"/>
Nov 14 05:27:05 user nova-compute[75469]:     </serial>
Nov 14 05:27:05 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:27:05 user nova-compute[75469]:     <video>
Nov 14 05:27:05 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:27:05 user nova-compute[75469]:     </video>
Nov 14 05:27:05 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:27:05 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:27:05 user nova-compute[75469]:     </rng>
Nov 14 05:27:05 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:27:05 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:27:05 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:27:05 user nova-compute[75469]:     </memballoon>
Nov 14 05:27:05 user nova-compute[75469]:   </devices>
Nov 14 05:27:05 user nova-compute[75469]: </domain>
Nov 14 05:27:05 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:27:05 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Instance destroyed successfully.
Nov 14 05:27:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:27:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:27:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No VIF found with MAC fa:16:3e:e2:64:6b, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:27:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-fcecced6-a24d-4938-84e6-b32ffe3d60e8 req-e5e40bb9-6ba3-4a9a-803a-7d74ad054a09 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:27:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fcecced6-a24d-4938-84e6-b32ffe3d60e8 req-e5e40bb9-6ba3-4a9a-803a-7d74ad054a09 service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:27:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fcecced6-a24d-4938-84e6-b32ffe3d60e8 req-e5e40bb9-6ba3-4a9a-803a-7d74ad054a09 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:27:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fcecced6-a24d-4938-84e6-b32ffe3d60e8 req-e5e40bb9-6ba3-4a9a-803a-7d74ad054a09 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:27:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-fcecced6-a24d-4938-84e6-b32ffe3d60e8 req-e5e40bb9-6ba3-4a9a-803a-7d74ad054a09 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:27:06 user nova-compute[75469]: WARNING nova.compute.manager [req-fcecced6-a24d-4938-84e6-b32ffe3d60e8 req-e5e40bb9-6ba3-4a9a-803a-7d74ad054a09 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received unexpected event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with vm_state active and task_state rescuing.
Nov 14 05:27:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:27:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:27:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:27:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:27:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:27:08 user nova-compute[75469]: WARNING nova.compute.manager [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received unexpected event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with vm_state active and task_state rescuing.
Nov 14 05:27:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:27:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:27:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:27:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:27:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:27:08 user nova-compute[75469]: WARNING nova.compute.manager [req-37631d37-a589-4a34-bf4c-5881183ea0e4 req-df6b661a-4aa9-4cf3-9155-568c912204be service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received unexpected event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with vm_state active and task_state rescuing.
Nov 14 05:27:08 user nova-compute[75469]: DEBUG nova.compute.manager [None req-8184c81b-a203-4efd-977a-2d00dedb9aa3 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:27:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:10 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:12 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:27:12 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:27:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9018MB free_disk=24.903785705566406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:27:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:27:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:27:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:27:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:27:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:27:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:27:12 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:27:12 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:27:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:27:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:27:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:27:16 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:27:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:27:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:27:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:27:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:27:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:27:16 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:27:16 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:27:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:27:16 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:27:17 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:27:18 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:27:18 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:27:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:27:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:27:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:27:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:27:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:27:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:27:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:20 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:27:21 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:27:23 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:27:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Verify base images {{(pid=75469) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Image id 7b828d08-5de0-47b5-a30d-5095d166987a yields fingerprint 44f9122883676232a0c9efb4788377a1723d86d2 {{(pid=75469) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] image 7b828d08-5de0-47b5-a30d-5095d166987a at (/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2): checking
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] image 7b828d08-5de0-47b5-a30d-5095d166987a at (/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2): image is in use {{(pid=75469) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75469) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] 2dcfec49-2eac-427a-8c3e-44b923538dcb is a valid instance name {{(pid=75469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] 2dcfec49-2eac-427a-8c3e-44b923538dcb has a disk file {{(pid=75469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb is backed by 44f9122883676232a0c9efb4788377a1723d86d2 {{(pid=75469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] 6d3008b2-b2ee-4a90-8fce-b134743aeb0a is a valid instance name {{(pid=75469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] 6d3008b2-b2ee-4a90-8fce-b134743aeb0a has a disk file {{(pid=75469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a is backed by 44f9122883676232a0c9efb4788377a1723d86d2 {{(pid=75469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 05:27:39 user nova-compute[75469]: WARNING nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Unknown base file: /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c
Nov 14 05:27:39 user nova-compute[75469]: WARNING nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Unknown base file: /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece
Nov 14 05:27:39 user nova-compute[75469]: WARNING nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Unknown base file: /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad
Nov 14 05:27:39 user nova-compute[75469]: WARNING nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Unknown base file: /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7
Nov 14 05:27:39 user nova-compute[75469]: WARNING nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Unknown base file: /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07
Nov 14 05:27:39 user nova-compute[75469]: WARNING nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Unknown base file: /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3
Nov 14 05:27:39 user nova-compute[75469]: WARNING nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Unknown base file: /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b
Nov 14 05:27:39 user nova-compute[75469]: WARNING nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Unknown base file: /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb
Nov 14 05:27:39 user nova-compute[75469]: WARNING nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Unknown base file: /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Active base files: /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Removable base files: /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7 /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07 /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3 /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5b99b387032977f1f7cd50b550c3f3dbc971066c
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3966fe6da1ff32544ff453932e1181c4b05a2ece
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1e57e18ba65f1c946e4152d312ea9966f2bfc2ad
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/071f76e21050dae1318aab8fd4b36890014ae7c7
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9a053c1b0e214e48c9f8a022a2767cb27d70af07
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6352eaef7369fb8fd7d32537fe3108c9ac92b1a3
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aa870f0206a5308acce37417ef1f1c700b74c40b
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/152c2dbe5f0b449a2af13a646ccb0aaae05eebdb
Nov 14 05:27:39 user nova-compute[75469]: INFO nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9d40f7d4b52495c0538560304d45d935597cd4be
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Verification complete {{(pid=75469) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Verify swap images {{(pid=75469) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 05:27:39 user nova-compute[75469]: DEBUG nova.virt.libvirt.imagecache [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Verify ephemeral images {{(pid=75469) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 05:27:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:27:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:27:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:27:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:27:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:27:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:28:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:28:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:28:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:28:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:28:11 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:28:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:28:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:28:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:28:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:28:13 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:28:13 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:28:13 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8934MB free_disk=24.902984619140625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 05:28:13 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 05:28:14 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:28:14 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:28:14 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:28:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:28:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:28:17 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:28:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:28:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:28:17 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:28:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updating instance_info_cache with network_info: [{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:28:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:28:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:28:18 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:28:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:28:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:28:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:28:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:20 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:20 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:20 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:28:23 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:28:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:28:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:28:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:28:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:28:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:43 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 05:28:43 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 05:28:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:28:43 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 05:28:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:28:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:28:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:28:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:28:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:28:54 user nova-compute[75469]: INFO nova.compute.manager [None req-39947c9a-7d4a-497f-ba0a-6b1dd032576a tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Unrescuing
Nov 14 05:28:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-39947c9a-7d4a-497f-ba0a-6b1dd032576a tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:28:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-39947c9a-7d4a-497f-ba0a-6b1dd032576a tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquired lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:28:54 user nova-compute[75469]: DEBUG nova.network.neutron [None req-39947c9a-7d4a-497f-ba0a-6b1dd032576a tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:28:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:28:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:28:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:28:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:28:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:28:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:28:54 user nova-compute[75469]: DEBUG nova.network.neutron [None req-39947c9a-7d4a-497f-ba0a-6b1dd032576a tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:28:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-39947c9a-7d4a-497f-ba0a-6b1dd032576a tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Releasing lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:28:54 user nova-compute[75469]: DEBUG nova.objects.instance [None req-39947c9a-7d4a-497f-ba0a-6b1dd032576a tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'flavor' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:28:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-3749c926-21d3-4fd6-9a25-1818907abb77 req-7a88de6d-a423-453f-a5ff-e8f01b179dc8 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-unplugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:28:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3749c926-21d3-4fd6-9a25-1818907abb77 req-7a88de6d-a423-453f-a5ff-e8f01b179dc8 service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:28:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3749c926-21d3-4fd6-9a25-1818907abb77 req-7a88de6d-a423-453f-a5ff-e8f01b179dc8 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:28:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3749c926-21d3-4fd6-9a25-1818907abb77 req-7a88de6d-a423-453f-a5ff-e8f01b179dc8 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:28:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-3749c926-21d3-4fd6-9a25-1818907abb77 req-7a88de6d-a423-453f-a5ff-e8f01b179dc8 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-unplugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:28:55 user nova-compute[75469]: WARNING nova.compute.manager [req-3749c926-21d3-4fd6-9a25-1818907abb77 req-7a88de6d-a423-453f-a5ff-e8f01b179dc8 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received unexpected event network-vif-unplugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:28:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:55 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Instance destroyed successfully.
Nov 14 05:28:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:28:57 user nova-compute[75469]: WARNING nova.compute.manager [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received unexpected event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:28:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:28:57 user nova-compute[75469]: WARNING nova.compute.manager [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received unexpected event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:28:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:28:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:28:57 user nova-compute[75469]: WARNING nova.compute.manager [req-fb649a0f-c471-4081-ae41-42ec2cd02ad1 req-42f7553f-2d8b-48cc-b850-f84b04236882 service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received unexpected event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:28:58 user nova-compute[75469]: DEBUG nova.compute.manager [None req-39947c9a-7d4a-497f-ba0a-6b1dd032576a tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:28:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:29:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:29:12 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:29:12 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:29:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8894MB free_disk=24.902019500732422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:29:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:29:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:17 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:29:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:29:17 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:29:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:29:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:29:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:29:18 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:29:18 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:29:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:29:18 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:29:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:29:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:29:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:20 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:29:21 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:29:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:29:22 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:29:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:23 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:29:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:29:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:29 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:29:29 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:29:29 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 2dcfec49-2eac-427a-8c3e-44b923538dcb {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:29:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:29:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:29:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:29:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:29:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:29:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:29:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:29:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:29:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:29:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:29:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:29:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:29:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:29:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:29:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:29:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:29:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:29:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:29:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:29:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:29:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:30:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:30:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:30:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:30:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:30:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:30:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:30:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:30:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:30:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:30:13 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:30:13 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:30:13 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.893402099609375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:30:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:30:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:30:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:30:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:30:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:30:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:30:20 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:30:20 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updating instance_info_cache with network_info: [{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:30:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:30:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:30:20 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:30:20 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:30:22 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:30:22 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:30:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:30:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:30:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:30:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:30:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:30:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:30:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:30:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:30:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:30:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:30:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:30:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:30:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:30:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG nova.compute.manager [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:30:49 user nova-compute[75469]: INFO nova.compute.claims [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Claim successful on node user
Nov 14 05:30:49 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG nova.compute.manager [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG nova.compute.manager [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG nova.network.neutron [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:30:49 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:30:49 user nova-compute[75469]: DEBUG nova.compute.manager [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG nova.policy [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '911ed16dc348429e878a32954ef7a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3c946ce0c4cf5830ff44cc0b1d99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG nova.compute.manager [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:30:49 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Creating image(s)
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:30:49 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk 1073741824" returned: 0 in 0.050s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Successfully created port: a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.202s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Cannot resize image /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Ensure instance console log exists: /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Successfully updated port: a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquired lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG nova.network.neutron [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG nova.compute.manager [req-ff781367-d47c-4be9-93d1-9139f70bb3d8 req-8d9eea19-d45f-45f7-a978-2ade8d07f168 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-changed-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG nova.compute.manager [req-ff781367-d47c-4be9-93d1-9139f70bb3d8 req-8d9eea19-d45f-45f7-a978-2ade8d07f168 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Refreshing instance network info cache due to event network-changed-a6e4e868-5b55-4fc0-975e-c58e2efe52b8. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:30:50 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ff781367-d47c-4be9-93d1-9139f70bb3d8 req-8d9eea19-d45f-45f7-a978-2ade8d07f168 service nova] Acquiring lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.network.neutron [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.network.neutron [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updating instance_info_cache with network_info: [{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Releasing lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.compute.manager [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Instance network_info: |[{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ff781367-d47c-4be9-93d1-9139f70bb3d8 req-8d9eea19-d45f-45f7-a978-2ade8d07f168 service nova] Acquired lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.network.neutron [req-ff781367-d47c-4be9-93d1-9139f70bb3d8 req-8d9eea19-d45f-45f7-a978-2ade8d07f168 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Refreshing network info cache for port a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Start _get_guest_xml network_info=[{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:30:51 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:30:51 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:30:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1731727504',display_name='tempest-ServerRescueNegativeTestJSON-server-1731727504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1731727504',id=51,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeOHO1zhNMiQA/8MIGFSQ2e9qR8NILkA1drCKf7JwPf8B4jAsAvYIWYs3mHLFN5c0QiWqyz8LBg3f1ciFTjNTqcBkZ8BsbGgfe5aWfzKUqkEExzsenQDLgmKwvTV5o1eQ==',key_name='tempest-keypair-1345085407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-8svpi4hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:30:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911ed16dc348429e878a32954ef7a725',uuid=4e74c5bd-42d3-479d-9d67-0e123216db40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:7f:36,bridge_name='br-int',has_traffic_filtering=True,id=a6e4e868-5b55-4fc0-975e-c58e2efe52b8,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e4e868-5b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.objects.instance [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:30:51 user nova-compute[75469]:   <uuid>4e74c5bd-42d3-479d-9d67-0e123216db40</uuid>
Nov 14 05:30:51 user nova-compute[75469]:   <name>instance-00000033</name>
Nov 14 05:30:51 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:30:51 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:30:51 user nova-compute[75469]:   <metadata>
Nov 14 05:30:51 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:30:51 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:30:51 user nova-compute[75469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1731727504</nova:name>
Nov 14 05:30:51 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:30:51</nova:creationTime>
Nov 14 05:30:51 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:30:51 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:30:51 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:30:51 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:30:51 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:30:51 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:30:51 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:30:51 user nova-compute[75469]:       <nova:owner>
Nov 14 05:30:51 user nova-compute[75469]:         <nova:user uuid="911ed16dc348429e878a32954ef7a725">tempest-ServerRescueNegativeTestJSON-207944883-project-member</nova:user>
Nov 14 05:30:51 user nova-compute[75469]:         <nova:project uuid="88f3c946ce0c4cf5830ff44cc0b1d99d">tempest-ServerRescueNegativeTestJSON-207944883</nova:project>
Nov 14 05:30:51 user nova-compute[75469]:       </nova:owner>
Nov 14 05:30:51 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:30:51 user nova-compute[75469]:       <nova:ports>
Nov 14 05:30:51 user nova-compute[75469]:         <nova:port uuid="a6e4e868-5b55-4fc0-975e-c58e2efe52b8">
Nov 14 05:30:51 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 05:30:51 user nova-compute[75469]:         </nova:port>
Nov 14 05:30:51 user nova-compute[75469]:       </nova:ports>
Nov 14 05:30:51 user nova-compute[75469]:     </nova:instance>
Nov 14 05:30:51 user nova-compute[75469]:   </metadata>
Nov 14 05:30:51 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:30:51 user nova-compute[75469]:     <system>
Nov 14 05:30:51 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:30:51 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:30:51 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:30:51 user nova-compute[75469]:       <entry name="serial">4e74c5bd-42d3-479d-9d67-0e123216db40</entry>
Nov 14 05:30:51 user nova-compute[75469]:       <entry name="uuid">4e74c5bd-42d3-479d-9d67-0e123216db40</entry>
Nov 14 05:30:51 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:30:51 user nova-compute[75469]:     </system>
Nov 14 05:30:51 user nova-compute[75469]:   </sysinfo>
Nov 14 05:30:51 user nova-compute[75469]:   <os>
Nov 14 05:30:51 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:30:51 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:30:51 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:30:51 user nova-compute[75469]:   </os>
Nov 14 05:30:51 user nova-compute[75469]:   <features>
Nov 14 05:30:51 user nova-compute[75469]:     <acpi/>
Nov 14 05:30:51 user nova-compute[75469]:     <apic/>
Nov 14 05:30:51 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:30:51 user nova-compute[75469]:   </features>
Nov 14 05:30:51 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:30:51 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:30:51 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:30:51 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:30:51 user nova-compute[75469]:   </clock>
Nov 14 05:30:51 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:30:51 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:30:51 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:30:51 user nova-compute[75469]:   </cpu>
Nov 14 05:30:51 user nova-compute[75469]:   <devices>
Nov 14 05:30:51 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:30:51 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:30:51 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk"/>
Nov 14 05:30:51 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:30:51 user nova-compute[75469]:     </disk>
Nov 14 05:30:51 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:30:51 user nova-compute[75469]:       <mac address="fa:16:3e:71:7f:36"/>
Nov 14 05:30:51 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:30:51 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:30:51 user nova-compute[75469]:       <target dev="tapa6e4e868-5b"/>
Nov 14 05:30:51 user nova-compute[75469]:     </interface>
Nov 14 05:30:51 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:30:51 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/console.log" append="off"/>
Nov 14 05:30:51 user nova-compute[75469]:     </serial>
Nov 14 05:30:51 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:30:51 user nova-compute[75469]:     <video>
Nov 14 05:30:51 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:30:51 user nova-compute[75469]:     </video>
Nov 14 05:30:51 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:30:51 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:30:51 user nova-compute[75469]:     </rng>
Nov 14 05:30:51 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:30:51 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:30:51 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:30:51 user nova-compute[75469]:     </memballoon>
Nov 14 05:30:51 user nova-compute[75469]:   </devices>
Nov 14 05:30:51 user nova-compute[75469]: </domain>
Nov 14 05:30:51 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:30:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1731727504',display_name='tempest-ServerRescueNegativeTestJSON-server-1731727504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1731727504',id=51,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeOHO1zhNMiQA/8MIGFSQ2e9qR8NILkA1drCKf7JwPf8B4jAsAvYIWYs3mHLFN5c0QiWqyz8LBg3f1ciFTjNTqcBkZ8BsbGgfe5aWfzKUqkEExzsenQDLgmKwvTV5o1eQ==',key_name='tempest-keypair-1345085407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-8svpi4hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:30:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911ed16dc348429e878a32954ef7a725',uuid=4e74c5bd-42d3-479d-9d67-0e123216db40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:7f:36,bridge_name='br-int',has_traffic_filtering=True,id=a6e4e868-5b55-4fc0-975e-c58e2efe52b8,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e4e868-5b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG os_vif [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:7f:36,bridge_name='br-int',has_traffic_filtering=True,id=a6e4e868-5b55-4fc0-975e-c58e2efe52b8,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e4e868-5b') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '426c6c8f-bb97-5c96-a645-25b2b81b7ea8', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6e4e868-5b, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6e4e868-5b, col_values=(('qos', UUID('c3bb2d7e-d16b-4ff8-b98e-cc144236ebb3')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6e4e868-5b, col_values=(('external_ids', {'iface-id': 'a6e4e868-5b55-4fc0-975e-c58e2efe52b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:7f:36', 'vm-uuid': '4e74c5bd-42d3-479d-9d67-0e123216db40'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:51 user nova-compute[75469]: INFO os_vif [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:7f:36,bridge_name='br-int',has_traffic_filtering=True,id=a6e4e868-5b55-4fc0-975e-c58e2efe52b8,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e4e868-5b')
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No VIF found with MAC fa:16:3e:71:7f:36, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.network.neutron [req-ff781367-d47c-4be9-93d1-9139f70bb3d8 req-8d9eea19-d45f-45f7-a978-2ade8d07f168 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updated VIF entry in instance network info cache for port a6e4e868-5b55-4fc0-975e-c58e2efe52b8. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG nova.network.neutron [req-ff781367-d47c-4be9-93d1-9139f70bb3d8 req-8d9eea19-d45f-45f7-a978-2ade8d07f168 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updating instance_info_cache with network_info: [{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:30:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-ff781367-d47c-4be9-93d1-9139f70bb3d8 req-8d9eea19-d45f-45f7-a978-2ade8d07f168 service nova] Releasing lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:30:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-78c58c9a-0d64-4408-8960-53304762a438 req-fb621ba5-f734-4964-b26f-3eb0f612119e service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:30:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-78c58c9a-0d64-4408-8960-53304762a438 req-fb621ba5-f734-4964-b26f-3eb0f612119e service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:30:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-78c58c9a-0d64-4408-8960-53304762a438 req-fb621ba5-f734-4964-b26f-3eb0f612119e service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:30:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-78c58c9a-0d64-4408-8960-53304762a438 req-fb621ba5-f734-4964-b26f-3eb0f612119e service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:30:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-78c58c9a-0d64-4408-8960-53304762a438 req-fb621ba5-f734-4964-b26f-3eb0f612119e service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:30:52 user nova-compute[75469]: WARNING nova.compute.manager [req-78c58c9a-0d64-4408-8960-53304762a438 req-fb621ba5-f734-4964-b26f-3eb0f612119e service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received unexpected event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with vm_state building and task_state spawning.
Nov 14 05:30:54 user nova-compute[75469]: DEBUG nova.compute.manager [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:30:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:30:54 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Instance spawned successfully.
Nov 14 05:30:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:30:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:30:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:30:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:30:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:30:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:30:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:30:54 user nova-compute[75469]: INFO nova.compute.manager [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 14 05:30:54 user nova-compute[75469]: DEBUG nova.compute.manager [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:30:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-f66a6863-b87f-474f-8ada-52badb2b8b62 req-f5352cb4-1349-4323-8735-9dd23cad25c0 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:30:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f66a6863-b87f-474f-8ada-52badb2b8b62 req-f5352cb4-1349-4323-8735-9dd23cad25c0 service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:30:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f66a6863-b87f-474f-8ada-52badb2b8b62 req-f5352cb4-1349-4323-8735-9dd23cad25c0 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:30:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f66a6863-b87f-474f-8ada-52badb2b8b62 req-f5352cb4-1349-4323-8735-9dd23cad25c0 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:30:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-f66a6863-b87f-474f-8ada-52badb2b8b62 req-f5352cb4-1349-4323-8735-9dd23cad25c0 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:30:55 user nova-compute[75469]: WARNING nova.compute.manager [req-f66a6863-b87f-474f-8ada-52badb2b8b62 req-f5352cb4-1349-4323-8735-9dd23cad25c0 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received unexpected event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with vm_state building and task_state spawning.
Nov 14 05:30:55 user nova-compute[75469]: INFO nova.compute.manager [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Took 5.92 seconds to build instance.
Nov 14 05:30:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-10054b77-5e81-4f0b-ba54-e1676ce9097c tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.017s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:30:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:30:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:31:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:31:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:31:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:31:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:31:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:31:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:31:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:31:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:31:13 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:31:14 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:31:14 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:31:14 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=24.865509033203125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:31:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:31:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:31:14 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:31:14 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:31:14 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4e74c5bd-42d3-479d-9d67-0e123216db40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:31:14 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:31:14 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:31:14 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:31:14 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:31:14 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:31:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:31:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:31:21 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:31:22 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:31:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:31:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:31:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:31:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:31:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:31:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:31:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:31:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:31:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:31:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:31:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:31:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:31:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:16 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:32:16 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:32:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=24.86315155029297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4e74c5bd-42d3-479d-9d67-0e123216db40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:32:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:32:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:22 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:32:22 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:32:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:32:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:32:22 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:32:23 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updating instance_info_cache with network_info: [{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:32:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:32:23 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:32:23 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:32:23 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:32:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:32:25 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:32:25 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:32:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:32:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:32:27 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:32:27 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:32:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:32:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:32:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:32:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:32:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:32:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-3bff6896-b4f2-4807-8eb6-5a2294338524 req-280b2acc-144f-43e5-8248-5af11878cca9 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-changed-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:32:39 user nova-compute[75469]: DEBUG nova.compute.manager [req-3bff6896-b4f2-4807-8eb6-5a2294338524 req-280b2acc-144f-43e5-8248-5af11878cca9 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Refreshing instance network info cache due to event network-changed-a6e4e868-5b55-4fc0-975e-c58e2efe52b8. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:32:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3bff6896-b4f2-4807-8eb6-5a2294338524 req-280b2acc-144f-43e5-8248-5af11878cca9 service nova] Acquiring lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:32:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3bff6896-b4f2-4807-8eb6-5a2294338524 req-280b2acc-144f-43e5-8248-5af11878cca9 service nova] Acquired lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:32:39 user nova-compute[75469]: DEBUG nova.network.neutron [req-3bff6896-b4f2-4807-8eb6-5a2294338524 req-280b2acc-144f-43e5-8248-5af11878cca9 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Refreshing network info cache for port a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'flavor' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:32:40 user nova-compute[75469]: INFO nova.compute.manager [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Attaching volume 8d3e6c6c-338d-449d-a194-f8a6a41a26aa to /dev/vdb
Nov 14 05:32:40 user nova-compute[75469]: DEBUG os_brick.utils [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2c9424-6a91-4a5f-9cdd-9f1f1e526f0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[041af56b-c429-4f64-bad7-c3034b40e65c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d231ebd8-1590-42f2-901f-6baad9de644c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec2eb32-9fc3-4552-b27a-0dabca0f53c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG nova.network.neutron [req-3bff6896-b4f2-4807-8eb6-5a2294338524 req-280b2acc-144f-43e5-8248-5af11878cca9 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updated VIF entry in instance network info cache for port a6e4e868-5b55-4fc0-975e-c58e2efe52b8. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG nova.network.neutron [req-3bff6896-b4f2-4807-8eb6-5a2294338524 req-280b2acc-144f-43e5-8248-5af11878cca9 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updating instance_info_cache with network_info: [{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-3bff6896-b4f2-4807-8eb6-5a2294338524 req-280b2acc-144f-43e5-8248-5af11878cca9 service nova] Releasing lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:32:40 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:32:40 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0fa37b-ce20-4ce7-9663-f314ded13d94]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG os_brick.utils [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:32:40 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updating existing volume attachment record: 9b4c0433-8e75-44a9-9c69-7d4e1f11a9b7 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:32:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xleKnJAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:32:44 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:32:44 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:32:44 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a4da86-e8c4-4f79-bf83-2ce51539ffb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:32:44 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6113902-1d76-4480-834a-ce421a38dc8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa] added
Nov 14 05:32:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a960ba-6e49-4f87-a1d4-9332f54b77af]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[409392e5-a0c4-4687-8f73-1f00ff44cc96]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xleKnJAC {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xleKnJAC" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[49697bfb-71ac-45a5-b724-74cbace0c6c7]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xleKnJAC'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2aa04c-dee6-48b4-83c7-8a71d909b4b4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a0e39a-a10e-4773-a83f-eaaf383bd870]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:32:44 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:32:44 user nova-compute[75469]:  {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:32:44 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 05:32:44 user nova-compute[75469]: 
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb1d223-26d1-4629-bca2-17916ec92a6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa, portal: 172.16.0.220,3260]
Nov 14 05:32:44 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa, portal: 172.16.0.220,3260] successful.
Nov 14 05:32:44 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3dfc62-93d9-4409-ba19-a7be0535cbf1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:32:44 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c39d4f8-9617-4824-a158-7d3854a73758]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa (non-flash)
Nov 14 05:32:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa (non-flash)
Nov 14 05:32:45 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab203b42-0ca3-45ec-aff2-884697ceea46]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:32:45 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xleKnJAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:32:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:32:46 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23538346364373733', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:32:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538346364373733', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:32:46 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'flavor' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:32:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:32:46 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:32:46 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:32:46 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:32:46 user nova-compute[75469]:   <serial>8d3e6c6c-338d-449d-a194-f8a6a41a26aa</serial>
Nov 14 05:32:46 user nova-compute[75469]: </disk>
Nov 14 05:32:46 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:32:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:32:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:32:46 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No VIF found with MAC fa:16:3e:71:7f:36, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:32:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4946c387-bd58-4ed1-bb2a-9c7c0e4d501e tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.161s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:32:47 user nova-compute[75469]: INFO nova.compute.manager [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Rescuing
Nov 14 05:32:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquired lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG nova.network.neutron [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updating instance_info_cache with network_info: [{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Releasing lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-53db7171-5385-4c8c-a786-48c14a5f531e req-f3e0de48-3259-4d47-8efa-3c3b08ee599a service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-unplugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-53db7171-5385-4c8c-a786-48c14a5f531e req-f3e0de48-3259-4d47-8efa-3c3b08ee599a service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-53db7171-5385-4c8c-a786-48c14a5f531e req-f3e0de48-3259-4d47-8efa-3c3b08ee599a service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-53db7171-5385-4c8c-a786-48c14a5f531e req-f3e0de48-3259-4d47-8efa-3c3b08ee599a service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:32:47 user nova-compute[75469]: DEBUG nova.compute.manager [req-53db7171-5385-4c8c-a786-48c14a5f531e req-f3e0de48-3259-4d47-8efa-3c3b08ee599a service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-unplugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:32:47 user nova-compute[75469]: WARNING nova.compute.manager [req-53db7171-5385-4c8c-a786-48c14a5f531e req-f3e0de48-3259-4d47-8efa-3c3b08ee599a service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received unexpected event network-vif-unplugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with vm_state active and task_state rescuing.
Nov 14 05:32:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:48 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Instance destroyed successfully.
Nov 14 05:32:48 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Attempting rescue
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Instance directory exists: not creating {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 05:32:48 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Creating image(s)
Nov 14 05:32:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "/opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.rescue {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.rescue" returned: 0 in 0.065s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'migration_context' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.objects.base [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<4e74c5bd-42d3-479d-9d67-0e123216db40> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Start _get_guest_xml network_info=[{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "vif_mac": "fa:16:3e:71:7f:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'resources' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.objects.base [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<4e74c5bd-42d3-479d-9d67-0e123216db40> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.objects.base [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<4e74c5bd-42d3-479d-9d67-0e123216db40> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:32:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:32:48 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.objects.base [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<4e74c5bd-42d3-479d-9d67-0e123216db40> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:30:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1731727504',display_name='tempest-ServerRescueNegativeTestJSON-server-1731727504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1731727504',id=51,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeOHO1zhNMiQA/8MIGFSQ2e9qR8NILkA1drCKf7JwPf8B4jAsAvYIWYs3mHLFN5c0QiWqyz8LBg3f1ciFTjNTqcBkZ8BsbGgfe5aWfzKUqkEExzsenQDLgmKwvTV5o1eQ==',key_name='tempest-keypair-1345085407',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:30:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-8svpi4hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911ed16dc348429e878a32954ef7a725',uuid=4e74c5bd-42d3-479d-9d67-0e123216db40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "vif_mac": "fa:16:3e:71:7f:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "vif_mac": "fa:16:3e:71:7f:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:36,bridge_name='br-int',has_traffic_filtering=True,id=a6e4e868-5b55-4fc0-975e-c58e2efe52b8,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e4e868-5b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.objects.instance [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.objects.base [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Object Instance<4e74c5bd-42d3-479d-9d67-0e123216db40> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75469) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 05:32:48 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:32:48 user nova-compute[75469]:   <uuid>4e74c5bd-42d3-479d-9d67-0e123216db40</uuid>
Nov 14 05:32:48 user nova-compute[75469]:   <name>instance-00000033</name>
Nov 14 05:32:48 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:32:48 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:32:48 user nova-compute[75469]:   <metadata>
Nov 14 05:32:48 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:32:48 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:32:48 user nova-compute[75469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1731727504</nova:name>
Nov 14 05:32:48 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:32:48</nova:creationTime>
Nov 14 05:32:48 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:32:48 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:32:48 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:32:48 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:32:48 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:32:48 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:32:48 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:32:48 user nova-compute[75469]:       <nova:owner>
Nov 14 05:32:48 user nova-compute[75469]:         <nova:user uuid="911ed16dc348429e878a32954ef7a725">tempest-ServerRescueNegativeTestJSON-207944883-project-member</nova:user>
Nov 14 05:32:48 user nova-compute[75469]:         <nova:project uuid="88f3c946ce0c4cf5830ff44cc0b1d99d">tempest-ServerRescueNegativeTestJSON-207944883</nova:project>
Nov 14 05:32:48 user nova-compute[75469]:       </nova:owner>
Nov 14 05:32:48 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:32:48 user nova-compute[75469]:       <nova:ports>
Nov 14 05:32:48 user nova-compute[75469]:         <nova:port uuid="a6e4e868-5b55-4fc0-975e-c58e2efe52b8">
Nov 14 05:32:48 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 05:32:48 user nova-compute[75469]:         </nova:port>
Nov 14 05:32:48 user nova-compute[75469]:       </nova:ports>
Nov 14 05:32:48 user nova-compute[75469]:     </nova:instance>
Nov 14 05:32:48 user nova-compute[75469]:   </metadata>
Nov 14 05:32:48 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:32:48 user nova-compute[75469]:     <system>
Nov 14 05:32:48 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:32:48 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:32:48 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:32:48 user nova-compute[75469]:       <entry name="serial">4e74c5bd-42d3-479d-9d67-0e123216db40</entry>
Nov 14 05:32:48 user nova-compute[75469]:       <entry name="uuid">4e74c5bd-42d3-479d-9d67-0e123216db40</entry>
Nov 14 05:32:48 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:32:48 user nova-compute[75469]:     </system>
Nov 14 05:32:48 user nova-compute[75469]:   </sysinfo>
Nov 14 05:32:48 user nova-compute[75469]:   <os>
Nov 14 05:32:48 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:32:48 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:32:48 user nova-compute[75469]:   </os>
Nov 14 05:32:48 user nova-compute[75469]:   <features>
Nov 14 05:32:48 user nova-compute[75469]:     <acpi/>
Nov 14 05:32:48 user nova-compute[75469]:     <apic/>
Nov 14 05:32:48 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:32:48 user nova-compute[75469]:   </features>
Nov 14 05:32:48 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:32:48 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:32:48 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:32:48 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:32:48 user nova-compute[75469]:   </clock>
Nov 14 05:32:48 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:32:48 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:32:48 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:32:48 user nova-compute[75469]:   </cpu>
Nov 14 05:32:48 user nova-compute[75469]:   <devices>
Nov 14 05:32:48 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:32:48 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:32:48 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.rescue"/>
Nov 14 05:32:48 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:32:48 user nova-compute[75469]:     </disk>
Nov 14 05:32:48 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:32:48 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:32:48 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk"/>
Nov 14 05:32:48 user nova-compute[75469]:       <target dev="vdb" bus="virtio"/>
Nov 14 05:32:48 user nova-compute[75469]:     </disk>
Nov 14 05:32:48 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:32:48 user nova-compute[75469]:       <mac address="fa:16:3e:71:7f:36"/>
Nov 14 05:32:48 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:32:48 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:32:48 user nova-compute[75469]:       <target dev="tapa6e4e868-5b"/>
Nov 14 05:32:48 user nova-compute[75469]:     </interface>
Nov 14 05:32:48 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:32:48 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/console.log" append="off"/>
Nov 14 05:32:48 user nova-compute[75469]:     </serial>
Nov 14 05:32:48 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:32:48 user nova-compute[75469]:     <video>
Nov 14 05:32:48 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:32:48 user nova-compute[75469]:     </video>
Nov 14 05:32:48 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:32:48 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:32:48 user nova-compute[75469]:     </rng>
Nov 14 05:32:48 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:32:48 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:32:48 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:32:48 user nova-compute[75469]:     </memballoon>
Nov 14 05:32:48 user nova-compute[75469]:   </devices>
Nov 14 05:32:48 user nova-compute[75469]: </domain>
Nov 14 05:32:48 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:32:48 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Instance destroyed successfully.
Nov 14 05:32:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:32:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:32:49 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] No VIF found with MAC fa:16:3e:71:7f:36, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:32:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-1932ec34-7e99-417b-b068-b3de60e65a2d req-8131d472-f9c6-4988-b13a-70daf52e51ce service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:32:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1932ec34-7e99-417b-b068-b3de60e65a2d req-8131d472-f9c6-4988-b13a-70daf52e51ce service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:32:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1932ec34-7e99-417b-b068-b3de60e65a2d req-8131d472-f9c6-4988-b13a-70daf52e51ce service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:32:49 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1932ec34-7e99-417b-b068-b3de60e65a2d req-8131d472-f9c6-4988-b13a-70daf52e51ce service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:32:49 user nova-compute[75469]: DEBUG nova.compute.manager [req-1932ec34-7e99-417b-b068-b3de60e65a2d req-8131d472-f9c6-4988-b13a-70daf52e51ce service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:32:49 user nova-compute[75469]: WARNING nova.compute.manager [req-1932ec34-7e99-417b-b068-b3de60e65a2d req-8131d472-f9c6-4988-b13a-70daf52e51ce service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received unexpected event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with vm_state active and task_state rescuing.
Nov 14 05:32:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:32:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:32:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:32:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:32:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:32:52 user nova-compute[75469]: WARNING nova.compute.manager [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received unexpected event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with vm_state active and task_state rescuing.
Nov 14 05:32:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:32:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:32:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:32:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:32:52 user nova-compute[75469]: DEBUG nova.compute.manager [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:32:52 user nova-compute[75469]: WARNING nova.compute.manager [req-a2657a20-658b-4481-b86e-2737d3d3d7b8 req-b73d27df-a7a1-47ac-8139-4c6391d60ef4 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received unexpected event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with vm_state active and task_state rescuing.
Nov 14 05:32:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:52 user nova-compute[75469]: DEBUG nova.compute.manager [None req-ad5a9b56-2544-44c3-b0c5-d1ba715e91c4 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:32:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:32:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:33:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:33:14 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:33:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:33:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:33:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:33:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:33:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:33:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:33:15 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:33:16 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:33:16 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=24.861343383789062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4e74c5bd-42d3-479d-9d67-0e123216db40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:33:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:33:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:33:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:33:24 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:33:25 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updating instance_info_cache with network_info: [{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:33:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:33:25 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:33:25 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:25 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:33:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:27 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:33:34 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:33:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:33:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:33:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:33:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:33:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:33:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:33:52 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:52 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 05:33:52 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 05:33:56 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:33:56 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 05:33:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:34:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:34:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:34:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:34:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:34:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:34:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:34:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:34:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:34:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:34:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:34:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:34:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:34:18 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:34:18 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:34:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=24.860698699951172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:34:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:34:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:34:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:34:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:34:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4e74c5bd-42d3-479d-9d67-0e123216db40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:34:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:34:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:34:18 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:34:18 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:34:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:34:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:34:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:34:25 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:34:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:27 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:34:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:34:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:34:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:34:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:34:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:34:29 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:34:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:38 user nova-compute[75469]: INFO nova.compute.manager [None req-73ef7224-a1e3-45cc-8c2f-3d443c2ff558 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Unrescuing
Nov 14 05:34:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-73ef7224-a1e3-45cc-8c2f-3d443c2ff558 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-73ef7224-a1e3-45cc-8c2f-3d443c2ff558 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquired lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-73ef7224-a1e3-45cc-8c2f-3d443c2ff558 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-73ef7224-a1e3-45cc-8c2f-3d443c2ff558 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updating instance_info_cache with network_info: [{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-73ef7224-a1e3-45cc-8c2f-3d443c2ff558 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Releasing lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG nova.objects.instance [None req-73ef7224-a1e3-45cc-8c2f-3d443c2ff558 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'flavor' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-e3451c6b-1da5-4c59-b911-39fef9f90028 req-c8999317-307f-48a4-8208-e3be621b2d24 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-unplugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e3451c6b-1da5-4c59-b911-39fef9f90028 req-c8999317-307f-48a4-8208-e3be621b2d24 service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e3451c6b-1da5-4c59-b911-39fef9f90028 req-c8999317-307f-48a4-8208-e3be621b2d24 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e3451c6b-1da5-4c59-b911-39fef9f90028 req-c8999317-307f-48a4-8208-e3be621b2d24 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG nova.compute.manager [req-e3451c6b-1da5-4c59-b911-39fef9f90028 req-c8999317-307f-48a4-8208-e3be621b2d24 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-unplugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:34:38 user nova-compute[75469]: WARNING nova.compute.manager [req-e3451c6b-1da5-4c59-b911-39fef9f90028 req-c8999317-307f-48a4-8208-e3be621b2d24 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received unexpected event network-vif-unplugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:34:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:38 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:39 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Instance destroyed successfully.
Nov 14 05:34:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:34:40 user nova-compute[75469]: WARNING nova.compute.manager [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received unexpected event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:34:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:34:40 user nova-compute[75469]: WARNING nova.compute.manager [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received unexpected event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:34:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:34:40 user nova-compute[75469]: DEBUG nova.compute.manager [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:34:40 user nova-compute[75469]: WARNING nova.compute.manager [req-a8e88672-c3cb-4270-ac66-a4058fb81895 req-0e8975c5-0fca-4c2b-87ec-1bfbeadc2f15 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received unexpected event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with vm_state rescued and task_state unrescuing.
Nov 14 05:34:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:42 user nova-compute[75469]: DEBUG nova.compute.manager [None req-73ef7224-a1e3-45cc-8c2f-3d443c2ff558 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:34:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:34:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:35:16 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:35:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:35:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:35:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:35:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:35:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:35:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:35:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:35:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:35:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:35:18 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:35:18 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:35:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=24.859554290771484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:35:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:35:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:35:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:35:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:35:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4e74c5bd-42d3-479d-9d67-0e123216db40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:35:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:35:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:35:18 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:35:18 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:35:18 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:35:18 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:35:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updating instance_info_cache with network_info: [{"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-2dcfec49-2eac-427a-8c3e-44b923538dcb" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:35:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:35:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:35:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:35:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:35:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:35:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:35:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:35:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:35:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:35:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:35:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:35:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:35:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:35:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:35:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:36:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:36:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:36:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:36:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:36:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:36:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:36:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:36:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:36:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:17 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:18 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:36:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:36:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8870MB free_disk=24.858993530273438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:36:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:36:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:36:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:36:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:36:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4e74c5bd-42d3-479d-9d67-0e123216db40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:36:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:36:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:36:19 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:36:19 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:36:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:36:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:36:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:36:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:36:27 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:36:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:36:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:36:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:36:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:36:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updating instance_info_cache with network_info: [{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:36:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:36:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:36:27 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:36:27 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:36:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:36:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:36:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:36:29 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:36:29 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:36:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-1f2db608-d936-4be2-ba29-8a3b7ebdfcbc req-ea67c1f6-c031-4fb5-97ba-51f49cc5fdc9 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-changed-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:36:29 user nova-compute[75469]: DEBUG nova.compute.manager [req-1f2db608-d936-4be2-ba29-8a3b7ebdfcbc req-ea67c1f6-c031-4fb5-97ba-51f49cc5fdc9 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Refreshing instance network info cache due to event network-changed-a6e4e868-5b55-4fc0-975e-c58e2efe52b8. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:36:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1f2db608-d936-4be2-ba29-8a3b7ebdfcbc req-ea67c1f6-c031-4fb5-97ba-51f49cc5fdc9 service nova] Acquiring lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:36:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1f2db608-d936-4be2-ba29-8a3b7ebdfcbc req-ea67c1f6-c031-4fb5-97ba-51f49cc5fdc9 service nova] Acquired lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:36:29 user nova-compute[75469]: DEBUG nova.network.neutron [req-1f2db608-d936-4be2-ba29-8a3b7ebdfcbc req-ea67c1f6-c031-4fb5-97ba-51f49cc5fdc9 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Refreshing network info cache for port a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:36:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:36:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:36:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:36:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:36:30 user nova-compute[75469]: INFO nova.compute.manager [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Detaching volume 8d3e6c6c-338d-449d-a194-f8a6a41a26aa
Nov 14 05:36:30 user nova-compute[75469]: DEBUG nova.network.neutron [req-1f2db608-d936-4be2-ba29-8a3b7ebdfcbc req-ea67c1f6-c031-4fb5-97ba-51f49cc5fdc9 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updated VIF entry in instance network info cache for port a6e4e868-5b55-4fc0-975e-c58e2efe52b8. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:36:30 user nova-compute[75469]: DEBUG nova.network.neutron [req-1f2db608-d936-4be2-ba29-8a3b7ebdfcbc req-ea67c1f6-c031-4fb5-97ba-51f49cc5fdc9 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updating instance_info_cache with network_info: [{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:36:30 user nova-compute[75469]: INFO nova.virt.block_device [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Attempting to driver detach volume 8d3e6c6c-338d-449d-a194-f8a6a41a26aa from mountpoint /dev/vdb
Nov 14 05:36:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Attempting to detach device vdb from instance 4e74c5bd-42d3-479d-9d67-0e123216db40 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:36:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:36:30 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:36:30 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:36:30 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:36:30 user nova-compute[75469]:   <serial>8d3e6c6c-338d-449d-a194-f8a6a41a26aa</serial>
Nov 14 05:36:30 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:36:30 user nova-compute[75469]: </disk>
Nov 14 05:36:30 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:36:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1f2db608-d936-4be2-ba29-8a3b7ebdfcbc req-ea67c1f6-c031-4fb5-97ba-51f49cc5fdc9 service nova] Releasing lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:36:30 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Successfully detached device vdb from instance 4e74c5bd-42d3-479d-9d67-0e123216db40 from the persistent domain config.
Nov 14 05:36:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e74c5bd-42d3-479d-9d67-0e123216db40 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:36:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:36:30 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:36:30 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:36:30 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:36:30 user nova-compute[75469]:   <serial>8d3e6c6c-338d-449d-a194-f8a6a41a26aa</serial>
Nov 14 05:36:30 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:36:30 user nova-compute[75469]: </disk>
Nov 14 05:36:30 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:36:30 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:36:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:36:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-71e010fe-345b-4846-8a55-77aa462d3d42 req-fc2cd473-a449-4e08-a2c7-c12ac69b9a6d service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-changed-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:36:31 user nova-compute[75469]: DEBUG nova.compute.manager [req-71e010fe-345b-4846-8a55-77aa462d3d42 req-fc2cd473-a449-4e08-a2c7-c12ac69b9a6d service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Refreshing instance network info cache due to event network-changed-a6e4e868-5b55-4fc0-975e-c58e2efe52b8. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:36:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-71e010fe-345b-4846-8a55-77aa462d3d42 req-fc2cd473-a449-4e08-a2c7-c12ac69b9a6d service nova] Acquiring lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:36:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-71e010fe-345b-4846-8a55-77aa462d3d42 req-fc2cd473-a449-4e08-a2c7-c12ac69b9a6d service nova] Acquired lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:36:31 user nova-compute[75469]: DEBUG nova.network.neutron [req-71e010fe-345b-4846-8a55-77aa462d3d42 req-fc2cd473-a449-4e08-a2c7-c12ac69b9a6d service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Refreshing network info cache for port a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:36:32 user nova-compute[75469]: DEBUG nova.network.neutron [req-71e010fe-345b-4846-8a55-77aa462d3d42 req-fc2cd473-a449-4e08-a2c7-c12ac69b9a6d service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updated VIF entry in instance network info cache for port a6e4e868-5b55-4fc0-975e-c58e2efe52b8. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:36:32 user nova-compute[75469]: DEBUG nova.network.neutron [req-71e010fe-345b-4846-8a55-77aa462d3d42 req-fc2cd473-a449-4e08-a2c7-c12ac69b9a6d service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updating instance_info_cache with network_info: [{"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:36:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-71e010fe-345b-4846-8a55-77aa462d3d42 req-fc2cd473-a449-4e08-a2c7-c12ac69b9a6d service nova] Releasing lock "refresh_cache-4e74c5bd-42d3-479d-9d67-0e123216db40" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:36:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:36:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:36:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:36:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:36:50 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4e74c5bd-42d3-479d-9d67-0e123216db40 is timed out.
Nov 14 05:36:50 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Successfully detached device vdb from instance 4e74c5bd-42d3-479d-9d67-0e123216db40 from the live domain config.
Nov 14 05:36:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xleKnJAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:36:50 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5b31aa-1333-4708-b3e4-4ba358391eff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:36:50 user nova-compute[75469]: No targets found.
Nov 14 05:36:50 user nova-compute[75469]: iSNS:
Nov 14 05:36:50 user nova-compute[75469]: No targets found.
Nov 14 05:36:50 user nova-compute[75469]: STATIC:
Nov 14 05:36:50 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa
Nov 14 05:36:50 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:36:50 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:36:50 user nova-compute[75469]: FIRMWARE:
Nov 14 05:36:50 user nova-compute[75469]: No targets found.
Nov 14 05:36:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:36:50 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:36:50 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b718c2-f48e-4e64-8ddd-9e2c9e665446]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea52d2-d950-4d70-89a3-d556b1d21133]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa (non-flash)
Nov 14 05:36:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa (non-flash)
Nov 14 05:36:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f6dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6401fd88-f1f1-4a03-bbee-eb89a04153cd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e78908-8efa-4bb9-b64c-82214f689b09]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[78370609-32d6-4bd5-9cc6-82af2c47e18b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a867d06-c629-49a9-8254-efce1e5c4f6c]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9cb8e7-d906-487a-aea7-c2b4e3350029]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96da396-2ffa-40ef-b0f5-c04dfd6e9a30]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa, portal: 172.16.0.220,3260]
Nov 14 05:36:50 user nova-compute[75469]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa, portal: 172.16.0.220,3260] successful.
Nov 14 05:36:50 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d3e6c6c-338d-449d-a194-f8a6a41a26aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acdc97b-9c6e-4679-ac1b-d22d31aefadf]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] <== disconnect_volume: return (303ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:36:50 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:36:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:36:51 user nova-compute[75469]: DEBUG nova.objects.instance [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'flavor' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:36:51 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-624c14e9-1b24-4824-94fa-d10a2cd7be10 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.587s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:36:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:37:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:37:20 user nova-compute[75469]: INFO nova.compute.manager [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Terminating instance
Nov 14 05:37:20 user nova-compute[75469]: DEBUG nova.compute.manager [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-7bb9b066-8d77-44c9-909c-321e6f599347 req-3975eef3-4041-4246-af23-b4e50eb5d5c3 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-unplugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7bb9b066-8d77-44c9-909c-321e6f599347 req-3975eef3-4041-4246-af23-b4e50eb5d5c3 service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7bb9b066-8d77-44c9-909c-321e6f599347 req-3975eef3-4041-4246-af23-b4e50eb5d5c3 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-7bb9b066-8d77-44c9-909c-321e6f599347 req-3975eef3-4041-4246-af23-b4e50eb5d5c3 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-7bb9b066-8d77-44c9-909c-321e6f599347 req-3975eef3-4041-4246-af23-b4e50eb5d5c3 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-unplugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG nova.compute.manager [req-7bb9b066-8d77-44c9-909c-321e6f599347 req-3975eef3-4041-4246-af23-b4e50eb5d5c3 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-unplugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:37:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:21 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:37:21 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=24.858261108398438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:37:21 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Instance destroyed successfully.
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.objects.instance [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'resources' on Instance uuid 4e74c5bd-42d3-479d-9d67-0e123216db40 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:30:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1731727504',display_name='tempest-ServerRescueNegativeTestJSON-server-1731727504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1731727504',id=51,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeOHO1zhNMiQA/8MIGFSQ2e9qR8NILkA1drCKf7JwPf8B4jAsAvYIWYs3mHLFN5c0QiWqyz8LBg3f1ciFTjNTqcBkZ8BsbGgfe5aWfzKUqkEExzsenQDLgmKwvTV5o1eQ==',key_name='tempest-keypair-1345085407',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:32:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-8svpi4hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:34:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911ed16dc348429e878a32954ef7a725',uuid=4e74c5bd-42d3-479d-9d67-0e123216db40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "address": "fa:16:3e:71:7f:36", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e4e868-5b", "ovs_interfaceid": "a6e4e868-5b55-4fc0-975e-c58e2efe52b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:36,bridge_name='br-int',has_traffic_filtering=True,id=a6e4e868-5b55-4fc0-975e-c58e2efe52b8,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e4e868-5b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG os_vif [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:36,bridge_name='br-int',has_traffic_filtering=True,id=a6e4e868-5b55-4fc0-975e-c58e2efe52b8,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e4e868-5b') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 4e74c5bd-42d3-479d-9d67-0e123216db40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6e4e868-5b, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3bb2d7e-d16b-4ff8-b98e-cc144236ebb3) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:37:21 user nova-compute[75469]: INFO os_vif [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:36,bridge_name='br-int',has_traffic_filtering=True,id=a6e4e868-5b55-4fc0-975e-c58e2efe52b8,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e4e868-5b')
Nov 14 05:37:21 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Deleting instance files /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40_del
Nov 14 05:37:21 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Deletion of /opt/stack/data/nova/instances/4e74c5bd-42d3-479d-9d67-0e123216db40_del complete
Nov 14 05:37:21 user nova-compute[75469]: INFO nova.compute.manager [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 05:37:21 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:37:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:37:22 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:37:22 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Took 0.89 seconds to deallocate network for instance.
Nov 14 05:37:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:37:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:37:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-7fc47eeb-a42b-4149-874d-4828917800d5 req-50787e70-cc7b-420e-9257-a0dee5252410 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-deleted-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:37:22 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:37:22 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:37:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:37:22 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Deleted allocations for instance 4e74c5bd-42d3-479d-9d67-0e123216db40
Nov 14 05:37:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-91d8bed6-5b6f-4a90-abde-c5cee55beb17 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.204s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:37:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-babc9d71-b2b2-45c4-970f-d0d3af109283 req-4e4aa541-e139-4be3-a712-a9312df54730 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:37:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-babc9d71-b2b2-45c4-970f-d0d3af109283 req-4e4aa541-e139-4be3-a712-a9312df54730 service nova] Acquiring lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:37:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-babc9d71-b2b2-45c4-970f-d0d3af109283 req-4e4aa541-e139-4be3-a712-a9312df54730 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:37:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-babc9d71-b2b2-45c4-970f-d0d3af109283 req-4e4aa541-e139-4be3-a712-a9312df54730 service nova] Lock "4e74c5bd-42d3-479d-9d67-0e123216db40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:37:22 user nova-compute[75469]: DEBUG nova.compute.manager [req-babc9d71-b2b2-45c4-970f-d0d3af109283 req-4e4aa541-e139-4be3-a712-a9312df54730 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] No waiting events found dispatching network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:37:22 user nova-compute[75469]: WARNING nova.compute.manager [req-babc9d71-b2b2-45c4-970f-d0d3af109283 req-4e4aa541-e139-4be3-a712-a9312df54730 service nova] [instance: 4e74c5bd-42d3-479d-9d67-0e123216db40] Received unexpected event network-vif-plugged-a6e4e868-5b55-4fc0-975e-c58e2efe52b8 for instance with vm_state deleted and task_state None.
Nov 14 05:37:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:27 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:37:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:37:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:37:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:37:27 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:37:27 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:37:27 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:37:28 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [{"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:37:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-6d3008b2-b2ee-4a90-8fce-b134743aeb0a" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:37:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:37:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:37:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:37:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:37:29 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:37:29 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:37:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:37:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:37:31 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:37:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:37:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:37:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:37:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:38:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:38:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:38:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:38:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:38:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:38:15 user nova-compute[75469]: INFO nova.compute.manager [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Terminating instance
Nov 14 05:38:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-e5206b92-44c5-4379-8cc0-c70c89c9bf60 req-fb50d106-d758-4874-9065-953e7bf05c46 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received event network-vif-unplugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e5206b92-44c5-4379-8cc0-c70c89c9bf60 req-fb50d106-d758-4874-9065-953e7bf05c46 service nova] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e5206b92-44c5-4379-8cc0-c70c89c9bf60 req-fb50d106-d758-4874-9065-953e7bf05c46 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-e5206b92-44c5-4379-8cc0-c70c89c9bf60 req-fb50d106-d758-4874-9065-953e7bf05c46 service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-e5206b92-44c5-4379-8cc0-c70c89c9bf60 req-fb50d106-d758-4874-9065-953e7bf05c46 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] No waiting events found dispatching network-vif-unplugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-e5206b92-44c5-4379-8cc0-c70c89c9bf60 req-fb50d106-d758-4874-9065-953e7bf05c46 service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received event network-vif-unplugged-ab315f7a-888a-4327-b927-dc3a9c90b62b for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Instance destroyed successfully.
Nov 14 05:38:15 user nova-compute[75469]: DEBUG nova.objects.instance [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'resources' on Instance uuid 2dcfec49-2eac-427a-8c3e-44b923538dcb {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2044441665',display_name='tempest-ServerRescueNegativeTestJSON-server-2044441665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2044441665',id=50,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:24:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-9pc161e7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:24:16Z,user_data=None,user_id='911ed16dc348429e878a32954ef7a725',uuid=2dcfec49-2eac-427a-8c3e-44b923538dcb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "address": "fa:16:3e:a1:b7:f7", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab315f7a-88", "ovs_interfaceid": "ab315f7a-888a-4327-b927-dc3a9c90b62b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=ab315f7a-888a-4327-b927-dc3a9c90b62b,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab315f7a-88') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG os_vif [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=ab315f7a-888a-4327-b927-dc3a9c90b62b,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab315f7a-88') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab315f7a-88, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff5154d1-3052-4bcc-8998-a11d7c74f842) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:38:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:38:15 user nova-compute[75469]: INFO os_vif [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=ab315f7a-888a-4327-b927-dc3a9c90b62b,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab315f7a-88')
Nov 14 05:38:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Deleting instance files /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb_del
Nov 14 05:38:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Deletion of /opt/stack/data/nova/instances/2dcfec49-2eac-427a-8c3e-44b923538dcb_del complete
Nov 14 05:38:16 user nova-compute[75469]: INFO nova.compute.manager [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 14 05:38:16 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:38:16 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Took 0.47 seconds to deallocate network for instance.
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-d565c1f9-953d-46ef-b942-3f8da3f68642 req-6980257b-c29c-4583-81d2-02a89dafdadf service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received event network-vif-deleted-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:38:16 user nova-compute[75469]: INFO nova.compute.manager [req-d565c1f9-953d-46ef-b942-3f8da3f68642 req-6980257b-c29c-4583-81d2-02a89dafdadf service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Neutron deleted interface ab315f7a-888a-4327-b927-dc3a9c90b62b; detaching it from the instance and deleting it from the info cache
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.network.neutron [req-d565c1f9-953d-46ef-b942-3f8da3f68642 req-6980257b-c29c-4583-81d2-02a89dafdadf service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.compute.manager [req-d565c1f9-953d-46ef-b942-3f8da3f68642 req-6980257b-c29c-4583-81d2-02a89dafdadf service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Detach interface failed, port_id=ab315f7a-888a-4327-b927-dc3a9c90b62b, reason: Instance 2dcfec49-2eac-427a-8c3e-44b923538dcb could not be found. {{(pid=75469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:38:16 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:38:17 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Deleted allocations for instance 2dcfec49-2eac-427a-8c3e-44b923538dcb
Nov 14 05:38:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-21017f8b-babf-4fd6-9da9-3bb88a721e32 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.771s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:38:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-c40095bd-70c5-431d-8179-6db40ec9b15c req-6517257a-db55-49ac-84a3-c7503e969cdd service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:38:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c40095bd-70c5-431d-8179-6db40ec9b15c req-6517257a-db55-49ac-84a3-c7503e969cdd service nova] Acquiring lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:38:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c40095bd-70c5-431d-8179-6db40ec9b15c req-6517257a-db55-49ac-84a3-c7503e969cdd service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:38:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c40095bd-70c5-431d-8179-6db40ec9b15c req-6517257a-db55-49ac-84a3-c7503e969cdd service nova] Lock "2dcfec49-2eac-427a-8c3e-44b923538dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:38:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-c40095bd-70c5-431d-8179-6db40ec9b15c req-6517257a-db55-49ac-84a3-c7503e969cdd service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] No waiting events found dispatching network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:38:17 user nova-compute[75469]: WARNING nova.compute.manager [req-c40095bd-70c5-431d-8179-6db40ec9b15c req-6517257a-db55-49ac-84a3-c7503e969cdd service nova] [instance: 2dcfec49-2eac-427a-8c3e-44b923538dcb] Received unexpected event network-vif-plugged-ab315f7a-888a-4327-b927-dc3a9c90b62b for instance with vm_state deleted and task_state None.
Nov 14 05:38:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:38:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:38:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:38:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:38:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:38:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:38:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:38:19 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:38:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:38:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:38:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=24.91360092163086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:38:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:38:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:38:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:38:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:38:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:38:20 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:38:20 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:38:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:38:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:38:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:38:26 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 05:38:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:31 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:31 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:31 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:38:32 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:32 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:32 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:45 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:38:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:38:59 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:38:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 05:38:59 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 05:39:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:39:06 user nova-compute[75469]: INFO nova.compute.manager [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Terminating instance
Nov 14 05:39:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-8f4f526a-45f7-46f3-a354-1caaa5dd5c37 req-be6f7c9d-2cb1-4e27-b9c1-cfa08a00372c service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-unplugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8f4f526a-45f7-46f3-a354-1caaa5dd5c37 req-be6f7c9d-2cb1-4e27-b9c1-cfa08a00372c service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8f4f526a-45f7-46f3-a354-1caaa5dd5c37 req-be6f7c9d-2cb1-4e27-b9c1-cfa08a00372c service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-8f4f526a-45f7-46f3-a354-1caaa5dd5c37 req-be6f7c9d-2cb1-4e27-b9c1-cfa08a00372c service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-8f4f526a-45f7-46f3-a354-1caaa5dd5c37 req-be6f7c9d-2cb1-4e27-b9c1-cfa08a00372c service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-unplugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-8f4f526a-45f7-46f3-a354-1caaa5dd5c37 req-be6f7c9d-2cb1-4e27-b9c1-cfa08a00372c service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-unplugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Instance destroyed successfully.
Nov 14 05:39:06 user nova-compute[75469]: DEBUG nova.objects.instance [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lazy-loading 'resources' on Instance uuid 6d3008b2-b2ee-4a90-8fce-b134743aeb0a {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-977647289',display_name='tempest-ServerRescueNegativeTestJSON-server-977647289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-977647289',id=49,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:27:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f3c946ce0c4cf5830ff44cc0b1d99d',ramdisk_id='',reservation_id='r-50eb08mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-207944883',owner_user_name='tempest-ServerRescueNegativeTestJSON-207944883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:28:59Z,user_data=None,user_id='911ed16dc348429e878a32954ef7a725',uuid=6d3008b2-b2ee-4a90-8fce-b134743aeb0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converting VIF {"id": "d34712dc-7f5b-4898-852a-9535d4751885", "address": "fa:16:3e:e2:64:6b", "network": {"id": "4933e930-2eb9-43a6-a9a7-546f2545fda3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-260843538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f3c946ce0c4cf5830ff44cc0b1d99d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34712dc-7f", "ovs_interfaceid": "d34712dc-7f5b-4898-852a-9535d4751885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:64:6b,bridge_name='br-int',has_traffic_filtering=True,id=d34712dc-7f5b-4898-852a-9535d4751885,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34712dc-7f') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG os_vif [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:64:6b,bridge_name='br-int',has_traffic_filtering=True,id=d34712dc-7f5b-4898-852a-9535d4751885,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34712dc-7f') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd34712dc-7f, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8801d75-4d17-49fc-86ba-0006d5217af7) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:39:06 user nova-compute[75469]: INFO os_vif [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:64:6b,bridge_name='br-int',has_traffic_filtering=True,id=d34712dc-7f5b-4898-852a-9535d4751885,network=Network(4933e930-2eb9-43a6-a9a7-546f2545fda3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34712dc-7f')
Nov 14 05:39:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Deleting instance files /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a_del
Nov 14 05:39:06 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Deletion of /opt/stack/data/nova/instances/6d3008b2-b2ee-4a90-8fce-b134743aeb0a_del complete
Nov 14 05:39:07 user nova-compute[75469]: INFO nova.compute.manager [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 05:39:07 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:39:07 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:39:07 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:39:08 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:39:08 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Took 0.91 seconds to deallocate network for instance.
Nov 14 05:39:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:39:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:39:08 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:39:08 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:39:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:39:08 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Deleted allocations for instance 6d3008b2-b2ee-4a90-8fce-b134743aeb0a
Nov 14 05:39:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-af950577-9727-4738-abe4-0c2892bd76d5 tempest-ServerRescueNegativeTestJSON-207944883 tempest-ServerRescueNegativeTestJSON-207944883-project-member] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.361s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:39:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-f3d9b9ea-40b1-4bc9-b7e8-093b46204f54 req-35b73bb3-6920-42ca-915d-94ba4df39b8f service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:39:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f3d9b9ea-40b1-4bc9-b7e8-093b46204f54 req-35b73bb3-6920-42ca-915d-94ba4df39b8f service nova] Acquiring lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:39:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f3d9b9ea-40b1-4bc9-b7e8-093b46204f54 req-35b73bb3-6920-42ca-915d-94ba4df39b8f service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:39:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-f3d9b9ea-40b1-4bc9-b7e8-093b46204f54 req-35b73bb3-6920-42ca-915d-94ba4df39b8f service nova] Lock "6d3008b2-b2ee-4a90-8fce-b134743aeb0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:39:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-f3d9b9ea-40b1-4bc9-b7e8-093b46204f54 req-35b73bb3-6920-42ca-915d-94ba4df39b8f service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] No waiting events found dispatching network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:39:08 user nova-compute[75469]: WARNING nova.compute.manager [req-f3d9b9ea-40b1-4bc9-b7e8-093b46204f54 req-35b73bb3-6920-42ca-915d-94ba4df39b8f service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received unexpected event network-vif-plugged-d34712dc-7f5b-4898-852a-9535d4751885 for instance with vm_state deleted and task_state None.
Nov 14 05:39:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-f3d9b9ea-40b1-4bc9-b7e8-093b46204f54 req-35b73bb3-6920-42ca-915d-94ba4df39b8f service nova] [instance: 6d3008b2-b2ee-4a90-8fce-b134743aeb0a] Received event network-vif-deleted-d34712dc-7f5b-4898-852a-9535d4751885 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:39:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:39:10 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 05:39:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:39:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:39:19 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:39:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9178MB free_disk=24.933326721191406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:39:19 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:39:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:39:27 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:39:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:39:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:39:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 05:39:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:39:29 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:39:31 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:39:31 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:39:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:39:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:39:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:39:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:39:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:32 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:39:32 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:39:33 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:39:33 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:39:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:39:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:39:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:39:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:39:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:39:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:39:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:39:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:39:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:39:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:40:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:40:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:40:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:40:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:40:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:40:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:40:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:40:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:40:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:40:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:40:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:40:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:40:20 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:40:20 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:40:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9185MB free_disk=24.93169403076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:40:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:40:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:40:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:40:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:40:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:40:28 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 05:40:29 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:40:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:40:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:32 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:40:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:40:33 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:40:34 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:40:34 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:40:34 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:40:35 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:40:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:40:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:41:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:41:06 user nova-compute[75469]: DEBUG nova.compute.manager [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:41:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:41:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:41:06 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:41:06 user nova-compute[75469]: INFO nova.compute.claims [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Claim successful on node user
Nov 14 05:41:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:41:07 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:41:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG nova.policy [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a4852497c6e4d4f9440c276506dcc23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d127f0c81247ed8b4582539bd32014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG nova.compute.manager [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:41:07 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Creating image(s)
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "/opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "/opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "/opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.171s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk 1073741824" returned: 0 in 0.047s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:41:07 user nova-compute[75469]: DEBUG nova.network.neutron [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Successfully created port: daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Cannot resize image /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Ensure instance console log exists: /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.network.neutron [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Successfully updated port: daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquired lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.network.neutron [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-c71e907f-aeab-4da4-8925-5c03612276a0 req-bb79ee11-e608-44d6-a603-2b31e9667400 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Received event network-changed-daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.compute.manager [req-c71e907f-aeab-4da4-8925-5c03612276a0 req-bb79ee11-e608-44d6-a603-2b31e9667400 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Refreshing instance network info cache due to event network-changed-daad33a7-5b3e-4503-8eab-473112ae5d68. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c71e907f-aeab-4da4-8925-5c03612276a0 req-bb79ee11-e608-44d6-a603-2b31e9667400 service nova] Acquiring lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.network.neutron [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.network.neutron [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating instance_info_cache with network_info: [{"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Releasing lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.compute.manager [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Instance network_info: |[{"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c71e907f-aeab-4da4-8925-5c03612276a0 req-bb79ee11-e608-44d6-a603-2b31e9667400 service nova] Acquired lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.network.neutron [req-c71e907f-aeab-4da4-8925-5c03612276a0 req-bb79ee11-e608-44d6-a603-2b31e9667400 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Refreshing network info cache for port daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Start _get_guest_xml network_info=[{"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:41:08 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:41:08 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:41:08 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1015384604',display_name='tempest-SnapshotDataIntegrityTests-server-1015384604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1015384604',id=52,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi1zkxFuigLxmn9Z2gymk3/fsc7/IHaL0s8F51NhGa9aimiQS8jL1+UYsURHaP0Ba414Kk8ZNDdIQI3u45z2mij0VkH5d9LiS/aRDL7hkILxHzM7fs/T7XGaeJlAeqPow==',key_name='tempest-keypair-1617396323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53d127f0c81247ed8b4582539bd32014',ramdisk_id='',reservation_id='r-l0adaidt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1229495854',owner_user_name='tempest-SnapshotDataIntegrityTests-1229495854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:41:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a4852497c6e4d4f9440c276506dcc23',uuid=f07c6e2a-9f27-451f-a173-cf0f9f91f43b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Converting VIF {"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:6e:37,bridge_name='br-int',has_traffic_filtering=True,id=daad33a7-5b3e-4503-8eab-473112ae5d68,network=Network(f8cab145-05fd-4867-b119-f83581c06f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaad33a7-5b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.objects.instance [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'pci_devices' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:41:09 user nova-compute[75469]:   <uuid>f07c6e2a-9f27-451f-a173-cf0f9f91f43b</uuid>
Nov 14 05:41:09 user nova-compute[75469]:   <name>instance-00000034</name>
Nov 14 05:41:09 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:41:09 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:41:09 user nova-compute[75469]:   <metadata>
Nov 14 05:41:09 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:41:09 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:41:09 user nova-compute[75469]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1015384604</nova:name>
Nov 14 05:41:09 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:41:08</nova:creationTime>
Nov 14 05:41:09 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:41:09 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:41:09 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:41:09 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:41:09 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:41:09 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:41:09 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:41:09 user nova-compute[75469]:       <nova:owner>
Nov 14 05:41:09 user nova-compute[75469]:         <nova:user uuid="9a4852497c6e4d4f9440c276506dcc23">tempest-SnapshotDataIntegrityTests-1229495854-project-member</nova:user>
Nov 14 05:41:09 user nova-compute[75469]:         <nova:project uuid="53d127f0c81247ed8b4582539bd32014">tempest-SnapshotDataIntegrityTests-1229495854</nova:project>
Nov 14 05:41:09 user nova-compute[75469]:       </nova:owner>
Nov 14 05:41:09 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:41:09 user nova-compute[75469]:       <nova:ports>
Nov 14 05:41:09 user nova-compute[75469]:         <nova:port uuid="daad33a7-5b3e-4503-8eab-473112ae5d68">
Nov 14 05:41:09 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 05:41:09 user nova-compute[75469]:         </nova:port>
Nov 14 05:41:09 user nova-compute[75469]:       </nova:ports>
Nov 14 05:41:09 user nova-compute[75469]:     </nova:instance>
Nov 14 05:41:09 user nova-compute[75469]:   </metadata>
Nov 14 05:41:09 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:41:09 user nova-compute[75469]:     <system>
Nov 14 05:41:09 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:41:09 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:41:09 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:41:09 user nova-compute[75469]:       <entry name="serial">f07c6e2a-9f27-451f-a173-cf0f9f91f43b</entry>
Nov 14 05:41:09 user nova-compute[75469]:       <entry name="uuid">f07c6e2a-9f27-451f-a173-cf0f9f91f43b</entry>
Nov 14 05:41:09 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:41:09 user nova-compute[75469]:     </system>
Nov 14 05:41:09 user nova-compute[75469]:   </sysinfo>
Nov 14 05:41:09 user nova-compute[75469]:   <os>
Nov 14 05:41:09 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:41:09 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:41:09 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:41:09 user nova-compute[75469]:   </os>
Nov 14 05:41:09 user nova-compute[75469]:   <features>
Nov 14 05:41:09 user nova-compute[75469]:     <acpi/>
Nov 14 05:41:09 user nova-compute[75469]:     <apic/>
Nov 14 05:41:09 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:41:09 user nova-compute[75469]:   </features>
Nov 14 05:41:09 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:41:09 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:41:09 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:41:09 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:41:09 user nova-compute[75469]:   </clock>
Nov 14 05:41:09 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:41:09 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:41:09 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:41:09 user nova-compute[75469]:   </cpu>
Nov 14 05:41:09 user nova-compute[75469]:   <devices>
Nov 14 05:41:09 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:41:09 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:41:09 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk"/>
Nov 14 05:41:09 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:41:09 user nova-compute[75469]:     </disk>
Nov 14 05:41:09 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:41:09 user nova-compute[75469]:       <mac address="fa:16:3e:eb:6e:37"/>
Nov 14 05:41:09 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:41:09 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:41:09 user nova-compute[75469]:       <target dev="tapdaad33a7-5b"/>
Nov 14 05:41:09 user nova-compute[75469]:     </interface>
Nov 14 05:41:09 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:41:09 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/console.log" append="off"/>
Nov 14 05:41:09 user nova-compute[75469]:     </serial>
Nov 14 05:41:09 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:41:09 user nova-compute[75469]:     <video>
Nov 14 05:41:09 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:41:09 user nova-compute[75469]:     </video>
Nov 14 05:41:09 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:41:09 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:41:09 user nova-compute[75469]:     </rng>
Nov 14 05:41:09 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:41:09 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:41:09 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:41:09 user nova-compute[75469]:     </memballoon>
Nov 14 05:41:09 user nova-compute[75469]:   </devices>
Nov 14 05:41:09 user nova-compute[75469]: </domain>
Nov 14 05:41:09 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1015384604',display_name='tempest-SnapshotDataIntegrityTests-server-1015384604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1015384604',id=52,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi1zkxFuigLxmn9Z2gymk3/fsc7/IHaL0s8F51NhGa9aimiQS8jL1+UYsURHaP0Ba414Kk8ZNDdIQI3u45z2mij0VkH5d9LiS/aRDL7hkILxHzM7fs/T7XGaeJlAeqPow==',key_name='tempest-keypair-1617396323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53d127f0c81247ed8b4582539bd32014',ramdisk_id='',reservation_id='r-l0adaidt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1229495854',owner_user_name='tempest-SnapshotDataIntegrityTests-1229495854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:41:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a4852497c6e4d4f9440c276506dcc23',uuid=f07c6e2a-9f27-451f-a173-cf0f9f91f43b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Converting VIF {"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:6e:37,bridge_name='br-int',has_traffic_filtering=True,id=daad33a7-5b3e-4503-8eab-473112ae5d68,network=Network(f8cab145-05fd-4867-b119-f83581c06f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaad33a7-5b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG os_vif [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:6e:37,bridge_name='br-int',has_traffic_filtering=True,id=daad33a7-5b3e-4503-8eab-473112ae5d68,network=Network(f8cab145-05fd-4867-b119-f83581c06f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaad33a7-5b') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d0334fb-a3c4-5113-9f09-44f627b0f4b3', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaad33a7-5b, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaad33a7-5b, col_values=(('qos', UUID('d67b09e8-54b5-4354-a240-21462cd59203')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaad33a7-5b, col_values=(('external_ids', {'iface-id': 'daad33a7-5b3e-4503-8eab-473112ae5d68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:6e:37', 'vm-uuid': 'f07c6e2a-9f27-451f-a173-cf0f9f91f43b'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:09 user nova-compute[75469]: INFO os_vif [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:6e:37,bridge_name='br-int',has_traffic_filtering=True,id=daad33a7-5b3e-4503-8eab-473112ae5d68,network=Network(f8cab145-05fd-4867-b119-f83581c06f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaad33a7-5b')
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No VIF found with MAC fa:16:3e:eb:6e:37, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-c71e907f-aeab-4da4-8925-5c03612276a0 req-bb79ee11-e608-44d6-a603-2b31e9667400 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updated VIF entry in instance network info cache for port daad33a7-5b3e-4503-8eab-473112ae5d68. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG nova.network.neutron [req-c71e907f-aeab-4da4-8925-5c03612276a0 req-bb79ee11-e608-44d6-a603-2b31e9667400 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating instance_info_cache with network_info: [{"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:41:09 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-c71e907f-aeab-4da4-8925-5c03612276a0 req-bb79ee11-e608-44d6-a603-2b31e9667400 service nova] Releasing lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:41:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-2765852b-d6e1-4618-8015-529730bb0df8 req-0d9c5cb5-8287-4af5-8697-aa18e1e6b7ea service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Received event network-vif-plugged-daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:41:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2765852b-d6e1-4618-8015-529730bb0df8 req-0d9c5cb5-8287-4af5-8697-aa18e1e6b7ea service nova] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:41:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2765852b-d6e1-4618-8015-529730bb0df8 req-0d9c5cb5-8287-4af5-8697-aa18e1e6b7ea service nova] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:41:10 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-2765852b-d6e1-4618-8015-529730bb0df8 req-0d9c5cb5-8287-4af5-8697-aa18e1e6b7ea service nova] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:41:10 user nova-compute[75469]: DEBUG nova.compute.manager [req-2765852b-d6e1-4618-8015-529730bb0df8 req-0d9c5cb5-8287-4af5-8697-aa18e1e6b7ea service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] No waiting events found dispatching network-vif-plugged-daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:41:10 user nova-compute[75469]: WARNING nova.compute.manager [req-2765852b-d6e1-4618-8015-529730bb0df8 req-0d9c5cb5-8287-4af5-8697-aa18e1e6b7ea service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Received unexpected event network-vif-plugged-daad33a7-5b3e-4503-8eab-473112ae5d68 for instance with vm_state building and task_state spawning.
Nov 14 05:41:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.compute.manager [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:41:12 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Instance spawned successfully.
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:41:12 user nova-compute[75469]: INFO nova.compute.manager [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.compute.manager [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-701cbdd6-06c7-4c31-8c36-cf0e89a5d42c req-390be852-1c35-404b-b98a-4a6f366c7637 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Received event network-vif-plugged-daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-701cbdd6-06c7-4c31-8c36-cf0e89a5d42c req-390be852-1c35-404b-b98a-4a6f366c7637 service nova] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-701cbdd6-06c7-4c31-8c36-cf0e89a5d42c req-390be852-1c35-404b-b98a-4a6f366c7637 service nova] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-701cbdd6-06c7-4c31-8c36-cf0e89a5d42c req-390be852-1c35-404b-b98a-4a6f366c7637 service nova] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:41:12 user nova-compute[75469]: DEBUG nova.compute.manager [req-701cbdd6-06c7-4c31-8c36-cf0e89a5d42c req-390be852-1c35-404b-b98a-4a6f366c7637 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] No waiting events found dispatching network-vif-plugged-daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:41:12 user nova-compute[75469]: WARNING nova.compute.manager [req-701cbdd6-06c7-4c31-8c36-cf0e89a5d42c req-390be852-1c35-404b-b98a-4a6f366c7637 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Received unexpected event network-vif-plugged-daad33a7-5b3e-4503-8eab-473112ae5d68 for instance with vm_state building and task_state spawning.
Nov 14 05:41:12 user nova-compute[75469]: INFO nova.compute.manager [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Took 5.88 seconds to build instance.
Nov 14 05:41:12 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-256499b7-f34f-4caf-bae2-061b582183fe tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.985s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:41:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:20 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:41:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:41:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:41:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:41:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:41:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:41:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:41:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:41:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:41:20 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:41:20 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:41:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=24.927753448486328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:41:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:41:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:41:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:41:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:41:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:41:21 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:41:21 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:41:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:41:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:41:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:41:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:41:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:41:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:41:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:41:30 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:41:30 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:41:30 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating instance_info_cache with network_info: [{"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:41:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:41:30 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:41:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:41:31 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:41:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:33 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:41:33 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:41:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:34 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:41:35 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:41:35 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:41:35 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:41:37 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:41:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:41:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:41:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:41:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:41:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:41:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:42:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:42:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:42:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:42:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:42:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:42:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:42:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:42:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:42:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:42:20 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:42:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:42:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:42:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:42:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:42:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:42:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:42:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:42:20 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:42:20 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:42:20 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:42:20 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=24.891555786132812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:42:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:42:20 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:42:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:42:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:42:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:42:21 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:42:21 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:42:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:42:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:42:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:42:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:42:31 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:42:31 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:42:31 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:42:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:42:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:42:31 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:42:31 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:42:31 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating instance_info_cache with network_info: [{"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:42:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:42:31 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:42:31 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:42:32 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:42:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:42:34 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:42:34 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:42:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:42:36 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:42:36 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:42:36 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:42:37 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:42:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:42:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:42:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:42:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:42:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-696f9558-f68c-47ae-918e-b0b2c10f62fb req-bf121208-3748-4c0c-a586-4557b8bdbb9b service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Received event network-changed-daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:42:57 user nova-compute[75469]: DEBUG nova.compute.manager [req-696f9558-f68c-47ae-918e-b0b2c10f62fb req-bf121208-3748-4c0c-a586-4557b8bdbb9b service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Refreshing instance network info cache due to event network-changed-daad33a7-5b3e-4503-8eab-473112ae5d68. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:42:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-696f9558-f68c-47ae-918e-b0b2c10f62fb req-bf121208-3748-4c0c-a586-4557b8bdbb9b service nova] Acquiring lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:42:57 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-696f9558-f68c-47ae-918e-b0b2c10f62fb req-bf121208-3748-4c0c-a586-4557b8bdbb9b service nova] Acquired lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:42:57 user nova-compute[75469]: DEBUG nova.network.neutron [req-696f9558-f68c-47ae-918e-b0b2c10f62fb req-bf121208-3748-4c0c-a586-4557b8bdbb9b service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Refreshing network info cache for port daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:42:58 user nova-compute[75469]: DEBUG nova.network.neutron [req-696f9558-f68c-47ae-918e-b0b2c10f62fb req-bf121208-3748-4c0c-a586-4557b8bdbb9b service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updated VIF entry in instance network info cache for port daad33a7-5b3e-4503-8eab-473112ae5d68. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:42:58 user nova-compute[75469]: DEBUG nova.network.neutron [req-696f9558-f68c-47ae-918e-b0b2c10f62fb req-bf121208-3748-4c0c-a586-4557b8bdbb9b service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating instance_info_cache with network_info: [{"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:42:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-696f9558-f68c-47ae-918e-b0b2c10f62fb req-bf121208-3748-4c0c-a586-4557b8bdbb9b service nova] Releasing lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:42:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:42:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:42:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:42:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:42:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:42:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:43:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:43:00 user nova-compute[75469]: DEBUG nova.objects.instance [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:43:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:43:01 user nova-compute[75469]: INFO nova.compute.manager [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attaching volume 78136d1e-f75b-449e-8634-0c55c84aeb45 to /dev/vdb
Nov 14 05:43:01 user nova-compute[75469]: DEBUG os_brick.utils [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0febec99-24c9-42ba-ae48-622f20fac8d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f36dcca-641d-496b-af49-1b4d03a60e00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d706e508-cb72-420b-a58c-8cc6ed91e440]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc35ca6f-d4c8-4aad-b1ae-2510c52b7e5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:43:01 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:43:01 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[62749490-9738-4f10-bed0-5e0fa8c47b53]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG os_brick.utils [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:43:01 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating existing volume attachment record: 549ba596-0125-49a3-b4d3-2fa2b4da1782 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:43:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkXIdyta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:43:05 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:43:05 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:43:05 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a073a747-bcb8-4d68-bd42-4a69d9917d35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:43:05 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e6cb4-a458-4fa2-9654-cafb82bf9eb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45] added
Nov 14 05:43:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0e4dae-6fc8-4e17-956f-f777b45d4c78]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f0ce0d-7139-4b2c-b63c-dfc3979b44c0]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YkXIdyta {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YkXIdyta" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[520e8830-60b4-4c63-a9fa-f455dc919a23]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YkXIdyta'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c67430-b29e-4837-ad8e-8e54ee4e98ec]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8f5736-e642-4b13-a58d-228a94e38a35]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:43:05 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:43:05 user nova-compute[75469]:  {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:43:05 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 05:43:05 user nova-compute[75469]: 
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[11759614-9a9d-4575-8c76-6ca1540027d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45, portal: 172.16.0.220,3260]
Nov 14 05:43:05 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45, portal: 172.16.0.220,3260] successful.
Nov 14 05:43:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[af425ee9-e8be-4e60-ba0d-d4de0d1c2b4e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755d8f1-8f0c-4533-9304-a0e816fd35ef]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 (non-flash)
Nov 14 05:43:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 (non-flash)
Nov 14 05:43:05 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afff514-06bf-466c-9292-fcc06886ff6c]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:43:05 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkXIdyta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:43:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:43:06 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23534653833666662', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:43:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534653833666662', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:43:06 user nova-compute[75469]: DEBUG nova.objects.instance [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:43:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:43:06 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:43:06 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:43:06 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:43:06 user nova-compute[75469]:   <serial>78136d1e-f75b-449e-8634-0c55c84aeb45</serial>
Nov 14 05:43:06 user nova-compute[75469]: </disk>
Nov 14 05:43:06 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:43:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:43:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:43:06 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No VIF found with MAC fa:16:3e:eb:6e:37, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:43:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-1d2eb231-d365-4879-a879-8dffb92091f2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.046s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:43:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:43:14 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:43:14 user nova-compute[75469]: INFO nova.compute.manager [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Detaching volume 78136d1e-f75b-449e-8634-0c55c84aeb45
Nov 14 05:43:14 user nova-compute[75469]: INFO nova.virt.block_device [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attempting to driver detach volume 78136d1e-f75b-449e-8634-0c55c84aeb45 from mountpoint /dev/vdb
Nov 14 05:43:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Attempting to detach device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:43:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:43:14 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:43:14 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:43:14 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:43:14 user nova-compute[75469]:   <serial>78136d1e-f75b-449e-8634-0c55c84aeb45</serial>
Nov 14 05:43:14 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:43:14 user nova-compute[75469]: </disk>
Nov 14 05:43:14 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:43:14 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Successfully detached device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the persistent domain config.
Nov 14 05:43:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:43:14 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:43:14 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:43:14 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:43:14 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:43:14 user nova-compute[75469]:   <serial>78136d1e-f75b-449e-8634-0c55c84aeb45</serial>
Nov 14 05:43:14 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:43:14 user nova-compute[75469]: </disk>
Nov 14 05:43:14 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:43:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:43:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:21 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:43:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:43:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:43:21 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:43:21 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:43:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:22 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:43:22 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9010MB free_disk=24.890300750732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:43:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:43:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:43:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:32 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:43:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:43:32 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:43:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:43:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:43:32 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:43:32 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:43:33 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating instance_info_cache with network_info: [{"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:43:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:43:33 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:43:33 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:43:34 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:43:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:43:35 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b is timed out.
Nov 14 05:43:35 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Successfully detached device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the live domain config.
Nov 14 05:43:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkXIdyta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:43:35 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8877c5e-2698-4cd1-8f7b-a099510184aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:43:35 user nova-compute[75469]: No targets found.
Nov 14 05:43:35 user nova-compute[75469]: iSNS:
Nov 14 05:43:35 user nova-compute[75469]: No targets found.
Nov 14 05:43:35 user nova-compute[75469]: STATIC:
Nov 14 05:43:35 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45
Nov 14 05:43:35 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:43:35 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:43:35 user nova-compute[75469]: FIRMWARE:
Nov 14 05:43:35 user nova-compute[75469]: No targets found.
Nov 14 05:43:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:43:35 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:43:35 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4dc9b1-90ca-455e-933e-3972c565d7a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[062c84c5-8c73-4b75-bb9d-2b7557bc9177]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 (non-flash)
Nov 14 05:43:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 (non-flash)
Nov 14 05:43:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708ec0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0656d3ec-3ad4-4a68-b667-566c437a3c97]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f505ba0-07fa-4813-839d-c45cd0535e67]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58ea2d9-a907-4c1c-a216-78e169928d85]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbea5330-039a-4f1b-a2c7-4ad98f7f90b6]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4bc8a8-3734-44da-b482-f9c12c3c53b7]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdcd65a-96b1-4854-90bd-88ea3773290b]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45, portal: 172.16.0.220,3260]
Nov 14 05:43:35 user nova-compute[75469]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45, portal: 172.16.0.220,3260] successful.
Nov 14 05:43:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78136d1e-f75b-449e-8634-0c55c84aeb45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bf566e-5a7d-4c79-8c0a-3bb5dc37abe6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== disconnect_volume: return (312ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:43:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:43:36 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:43:36 user nova-compute[75469]: DEBUG nova.objects.instance [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:43:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-56450dde-e70f-491a-995a-b8400f154591 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.632s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:43:37 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:43:37 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:43:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:43:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:43:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:43:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:43:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:43:57 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:43:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:44:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:44:05 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 05:44:05 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 05:44:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:44:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:44:06 user nova-compute[75469]: DEBUG nova.objects.instance [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:44:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:44:07 user nova-compute[75469]: INFO nova.compute.manager [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attaching volume 4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 to /dev/vdb
Nov 14 05:44:07 user nova-compute[75469]: DEBUG os_brick.utils [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb9eec2-5d4f-49a0-969a-ae78ea755112]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[330c83a5-0959-4a86-b2d7-66e62b72b37f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8966a842-d286-401e-b71f-366a4f284057]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[12288714-7ac5-41e7-904d-9dd38c9f6afb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:44:07 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:44:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[769e0556-d657-4381-b7bc-f5db0c81b930]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG os_brick.utils [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating existing volume attachment record: 217a8855-9700-4837-b582-5ff9a65e17e4 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:44:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:44:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFbPUrgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:44:11 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:44:11 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:44:11 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f18f33-d0a7-4853-a525-bfa37955580d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:44:11 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f44d049-4ce0-4b12-b7c3-61b5784c2b18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0] added
Nov 14 05:44:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef076dd1-c8e2-4ecd-8271-376a57e4d3d3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ede77fc-2427-496e-b542-560fe6dde0a1]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFbPUrgX {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFbPUrgX" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2add64-ac10-494a-aa99-7a264f43a4d9]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IFbPUrgX'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9ddaf0-74cb-47d3-ace9-3a2645431d4c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cefc6a-d9ca-492d-9949-4b80a058d8ab]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:44:11 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:44:11 user nova-compute[75469]:  {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:44:11 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 05:44:11 user nova-compute[75469]: 
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4a5dc1-10a8-4213-b0b7-8c2490a7b46a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0, portal: 172.16.0.220,3260]
Nov 14 05:44:11 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0, portal: 172.16.0.220,3260] successful.
Nov 14 05:44:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f2ca82-5a96-4c38-affe-09204340d6b6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d0b97d-466e-44be-932b-961e3577c91b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 (non-flash)
Nov 14 05:44:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 (non-flash)
Nov 14 05:44:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8b8c0d-1194-4a63-a03b-a8848a9bfdc7]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:44:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFbPUrgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:44:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:44:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23537396165353837', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:44:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537396165353837', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:44:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:44:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:44:12 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:44:12 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:44:12 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:44:12 user nova-compute[75469]:   <serial>4e524dab-11cf-4b41-b6f9-8e1aaeac15d0</serial>
Nov 14 05:44:12 user nova-compute[75469]: </disk>
Nov 14 05:44:12 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:44:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:44:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:44:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No VIF found with MAC fa:16:3e:eb:6e:37, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:44:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fd0bc6a1-dbb6-4b9c-95be-0f2ce6319146 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.129s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:44:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:44:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:44:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:44:15 user nova-compute[75469]: INFO nova.compute.manager [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Detaching volume 4e524dab-11cf-4b41-b6f9-8e1aaeac15d0
Nov 14 05:44:15 user nova-compute[75469]: INFO nova.virt.block_device [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attempting to driver detach volume 4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 from mountpoint /dev/vdb
Nov 14 05:44:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Attempting to detach device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:44:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:44:15 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:44:15 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:44:15 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:44:15 user nova-compute[75469]:   <serial>4e524dab-11cf-4b41-b6f9-8e1aaeac15d0</serial>
Nov 14 05:44:15 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:44:15 user nova-compute[75469]: </disk>
Nov 14 05:44:15 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:44:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Successfully detached device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the persistent domain config.
Nov 14 05:44:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:44:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:44:15 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:44:15 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:44:15 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:44:15 user nova-compute[75469]:   <serial>4e524dab-11cf-4b41-b6f9-8e1aaeac15d0</serial>
Nov 14 05:44:15 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:44:15 user nova-compute[75469]: </disk>
Nov 14 05:44:15 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:44:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:44:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:44:19 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:19 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 05:44:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:44:23 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:44:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:44:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:44:23 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:44:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:24 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:44:24 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:44:24 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=24.88934326171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:44:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:44:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:44:24 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:44:24 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:44:24 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:44:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:44:24 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:44:24 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:44:24 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:44:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:44:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating instance_info_cache with network_info: [{"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:44:34 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:35 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b is timed out.
Nov 14 05:44:35 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Successfully detached device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the live domain config.
Nov 14 05:44:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFbPUrgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:44:35 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d11fb6-6772-4617-95bc-5d646cd0de39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:44:35 user nova-compute[75469]: No targets found.
Nov 14 05:44:35 user nova-compute[75469]: iSNS:
Nov 14 05:44:35 user nova-compute[75469]: No targets found.
Nov 14 05:44:35 user nova-compute[75469]: STATIC:
Nov 14 05:44:35 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0
Nov 14 05:44:35 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:44:35 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:44:35 user nova-compute[75469]: FIRMWARE:
Nov 14 05:44:35 user nova-compute[75469]: No targets found.
Nov 14 05:44:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:44:35 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:44:35 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6ce154-61c5-452c-adb9-8c0d35084478]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f6966a-2232-4962-aa88-7af9cd0cbfb0]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 (non-flash)
Nov 14 05:44:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 (non-flash)
Nov 14 05:44:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa74c2475b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cafe852-4fe8-4320-889d-7775bf14af2a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b581a1c4-b9bb-48ba-bb5a-7cc5b325db85]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cfc61a-4e12-4b04-be9d-bedc289c473e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae147f4-a131-42a0-8dd2-60d52c2e8a05]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a59ccb4-93bd-4f11-9c79-6fa45ce29b33]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fec485-0235-477e-9db3-1476b10c5129]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0, portal: 172.16.0.220,3260]
Nov 14 05:44:35 user nova-compute[75469]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0, portal: 172.16.0.220,3260] successful.
Nov 14 05:44:35 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e524dab-11cf-4b41-b6f9-8e1aaeac15d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12621a7-01fa-485d-b212-60080526ee3f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== disconnect_volume: return (310ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:44:35 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:44:36 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:44:36 user nova-compute[75469]: DEBUG nova.objects.instance [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:44:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-07953061-a74b-4672-93be-b629f555a822 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.613s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:44:38 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:38 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:38 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:44:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:44:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:44:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:44:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:44:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:44:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:44:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:44:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:44:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:44:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:45:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG nova.objects.instance [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:45:07 user nova-compute[75469]: INFO nova.compute.manager [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attaching volume 43d593d7-8209-426b-8213-5a43f7f39f30 to /dev/vdb
Nov 14 05:45:07 user nova-compute[75469]: DEBUG os_brick.utils [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b759cdf0-2157-4a4b-bf43-9fcdadabe4fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[38123ead-ea3e-466c-b119-81857f12d1a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55a5ea8-5221-47b9-84e4-3a8946c8e69a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[305515fb-eec0-478f-92b9-79fb0d9b0c45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:45:07 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:45:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e53f99c-9c04-4c49-a113-73d2a5fc9a79]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG os_brick.utils [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:45:07 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating existing volume attachment record: 3d398370-c2c5-44b2-a307-89ee085dab9a {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:45:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoibSQux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:45:11 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:45:11 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:45:11 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[729118ed-a383-4f62-9345-232e36c66c60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:45:11 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b8881-5c28-4328-aea7-52e829e8ea64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30] added
Nov 14 05:45:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[198fe777-072d-41f1-9ed6-f6381fff15b9]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5d4add-b074-40dc-acca-92111f4a0879]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HoibSQux {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HoibSQux" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[024e6f46-ebb9-4903-abdb-9b3666124128]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HoibSQux'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2af0e46-e5c8-4a50-89e5-e551df406e7b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2f3924-0bab-4241-986e-92802a779d06]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:45:11 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:45:11 user nova-compute[75469]:  {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:45:11 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 05:45:11 user nova-compute[75469]: 
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e79e8f-db38-4ab6-a7ad-a3578d217603]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30, portal: 172.16.0.220,3260]
Nov 14 05:45:11 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30, portal: 172.16.0.220,3260] successful.
Nov 14 05:45:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d19884-1efc-4707-8b91-82d41ff6bb40]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaf9350-3dc1-4674-85fa-fdbf1d4afddb]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 (non-flash)
Nov 14 05:45:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 (non-flash)
Nov 14 05:45:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad44863-55b2-42c3-b9de-176376cb9c1a]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:45:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoibSQux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:45:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:45:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26366613561306537', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:45:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366613561306537', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:45:12 user nova-compute[75469]: DEBUG nova.objects.instance [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:45:12 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:45:12 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:45:12 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:45:12 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:45:12 user nova-compute[75469]:   <serial>43d593d7-8209-426b-8213-5a43f7f39f30</serial>
Nov 14 05:45:12 user nova-compute[75469]: </disk>
Nov 14 05:45:12 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:45:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:45:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:45:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No VIF found with MAC fa:16:3e:eb:6e:37, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:45:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-0865e20b-99e2-45a1-be21-fefa87ea5333 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.039s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:45:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:45:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:45:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:45:15 user nova-compute[75469]: INFO nova.compute.manager [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Detaching volume 43d593d7-8209-426b-8213-5a43f7f39f30
Nov 14 05:45:15 user nova-compute[75469]: INFO nova.virt.block_device [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attempting to driver detach volume 43d593d7-8209-426b-8213-5a43f7f39f30 from mountpoint /dev/vdb
Nov 14 05:45:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Attempting to detach device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:45:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:45:15 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:45:15 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:45:15 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:45:15 user nova-compute[75469]:   <serial>43d593d7-8209-426b-8213-5a43f7f39f30</serial>
Nov 14 05:45:15 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:45:15 user nova-compute[75469]: </disk>
Nov 14 05:45:15 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:45:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Successfully detached device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the persistent domain config.
Nov 14 05:45:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:45:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:45:15 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:45:15 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:45:15 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:45:15 user nova-compute[75469]:   <serial>43d593d7-8209-426b-8213-5a43f7f39f30</serial>
Nov 14 05:45:15 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:45:15 user nova-compute[75469]: </disk>
Nov 14 05:45:15 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:45:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:45:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:45:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:45:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:45:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:45:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:45:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:45:24 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:45:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:45:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:24 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:45:25 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:45:25 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=24.888385772705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:45:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:45:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:45:25 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:45:25 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:45:25 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:45:25 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:45:25 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:45:25 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:45:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:45:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:45:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:45:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:45:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:45:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:45:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:45:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:45:36 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b is timed out.
Nov 14 05:45:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Successfully detached device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the live domain config.
Nov 14 05:45:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoibSQux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:45:36 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3a578e-b228-4f30-9a5c-7a1d3e06a9c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:45:36 user nova-compute[75469]: No targets found.
Nov 14 05:45:36 user nova-compute[75469]: iSNS:
Nov 14 05:45:36 user nova-compute[75469]: No targets found.
Nov 14 05:45:36 user nova-compute[75469]: STATIC:
Nov 14 05:45:36 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30
Nov 14 05:45:36 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:45:36 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:45:36 user nova-compute[75469]: FIRMWARE:
Nov 14 05:45:36 user nova-compute[75469]: No targets found.
Nov 14 05:45:36 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:45:36 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:45:36 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7796446-b36a-4391-8e7f-4768fa1fe0fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[76101e03-f9c9-41f0-a0d6-3f60a8fbcbac]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 (non-flash)
Nov 14 05:45:36 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 (non-flash)
Nov 14 05:45:36 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708d9eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aafab69-215f-45ac-8dd7-2a882bb7c012]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97583ea-ed76-4233-8816-fd966b4cd223]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fe65d4-1ebf-4e2a-831f-5511191f1cfe]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f6250c-76fb-4234-b8eb-6cc2e9f81f2c]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[53657117-2903-4162-8869-a1cd3e3ce270]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b7125c-6e4e-4e13-8661-b40ea44ed1b3]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30, portal: 172.16.0.220,3260]
Nov 14 05:45:36 user nova-compute[75469]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30, portal: 172.16.0.220,3260] successful.
Nov 14 05:45:36 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43d593d7-8209-426b-8213-5a43f7f39f30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73bdef6-fc4e-49c2-9f27-333aab09c9a8]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== disconnect_volume: return (283ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating instance_info_cache with network_info: [{"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:45:36 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:45:37 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:45:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:45:37 user nova-compute[75469]: DEBUG nova.objects.instance [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:45:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-53d55846-fc90-4a75-9b55-ad92508623e7 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.845s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:45:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:45:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:45:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:45:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:45:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:45:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:45:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:45:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:45:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:46:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG nova.objects.instance [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:46:07 user nova-compute[75469]: INFO nova.compute.manager [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attaching volume 286fd396-46ad-4bf2-bd00-cde9721864fe to /dev/vdb
Nov 14 05:46:07 user nova-compute[75469]: DEBUG os_brick.utils [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87bb2b5-2973-482e-b98d-506a2fbf13a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ab0d07-63ec-4c92-9662-b48ea029e0d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[999caec6-dff9-4a73-b1d4-92a2a582114e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6257c083-ef0d-4b95-87ab-5174ed5646d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:46:07 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:46:07 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0f460e-56a0-4808-9a80-4d0b3a6400a0]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG os_brick.utils [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:46:07 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating existing volume attachment record: 1007f2dd-f07b-4991-9bbb-4cb2c7c75bcc {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:46:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpISuVHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:46:11 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:46:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:46:11 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:46:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:46:11 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:46:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[276afb0d-74df-4be1-b873-7be1f75cf5ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:46:11 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[749c39ec-ee80-47fd-a9ff-0b858a217cf5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe] added
Nov 14 05:46:11 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:46:11 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[955a7154-fc21-40bf-a6c2-80cabf9489eb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3d49df-f3a6-4b23-b786-4708fa1a5655]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpISuVHv {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpISuVHv" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6af1f5-bd83-4bf4-98e1-3ab0faef6909]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bpISuVHv'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55b25ab-ef0f-416c-910b-0e8796ab3b0b]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c04ecc-a866-4034-84ac-2fa1f153c2e3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:46:12 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:46:12 user nova-compute[75469]:  {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:46:12 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 05:46:12 user nova-compute[75469]: 
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd6239b-c585-4780-9615-362b58015f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe, portal: 172.16.0.220,3260]
Nov 14 05:46:12 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe, portal: 172.16.0.220,3260] successful.
Nov 14 05:46:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[805d5380-340f-4c5e-b88b-2bddb8800f96]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d6d86c-af6b-4caf-9a5c-66713678305f]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe (non-flash)
Nov 14 05:46:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe (non-flash)
Nov 14 05:46:12 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f59a0ec-9b4d-4039-b6b4-605fcb3b047e]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:46:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:46:13 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:46:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpISuVHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:46:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:46:13 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26164633934366562', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:46:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164633934366562', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:46:13 user nova-compute[75469]: DEBUG nova.objects.instance [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:46:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:46:13 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:46:13 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:46:13 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:46:13 user nova-compute[75469]:   <serial>286fd396-46ad-4bf2-bd00-cde9721864fe</serial>
Nov 14 05:46:13 user nova-compute[75469]: </disk>
Nov 14 05:46:13 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:46:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:46:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:46:13 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] No VIF found with MAC fa:16:3e:eb:6e:37, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:46:13 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-85c92056-c0ca-4e54-ad23-df69b55a1205 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.119s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:46:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:46:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:46:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:46:15 user nova-compute[75469]: INFO nova.compute.manager [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Detaching volume 286fd396-46ad-4bf2-bd00-cde9721864fe
Nov 14 05:46:15 user nova-compute[75469]: INFO nova.virt.block_device [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Attempting to driver detach volume 286fd396-46ad-4bf2-bd00-cde9721864fe from mountpoint /dev/vdb
Nov 14 05:46:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Attempting to detach device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:46:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:46:15 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:46:15 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:46:15 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:46:15 user nova-compute[75469]:   <serial>286fd396-46ad-4bf2-bd00-cde9721864fe</serial>
Nov 14 05:46:15 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:46:15 user nova-compute[75469]: </disk>
Nov 14 05:46:15 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:46:15 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Successfully detached device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the persistent domain config.
Nov 14 05:46:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:46:15 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:46:15 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:46:15 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:46:15 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:46:15 user nova-compute[75469]:   <serial>286fd396-46ad-4bf2-bd00-cde9721864fe</serial>
Nov 14 05:46:15 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:46:15 user nova-compute[75469]: </disk>
Nov 14 05:46:15 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:46:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:46:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:46:19 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:46:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:46:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:46:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:46:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:46:24 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:46:24 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:46:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:24 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:25 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:46:25 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:46:25 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=24.887447357177734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:46:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:46:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:46:25 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:46:25 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:46:25 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:46:25 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:46:25 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:46:25 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:46:25 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:46:29 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:46:34 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:46:36 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b is timed out.
Nov 14 05:46:36 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Successfully detached device vdb from instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b from the live domain config.
Nov 14 05:46:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpISuVHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:46:36 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9b88e0-d4b0-4a48-b1c7-09dfc8550a88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:46:36 user nova-compute[75469]: No targets found.
Nov 14 05:46:36 user nova-compute[75469]: iSNS:
Nov 14 05:46:36 user nova-compute[75469]: No targets found.
Nov 14 05:46:36 user nova-compute[75469]: STATIC:
Nov 14 05:46:36 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe
Nov 14 05:46:36 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:46:36 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:46:36 user nova-compute[75469]: FIRMWARE:
Nov 14 05:46:36 user nova-compute[75469]: No targets found.
Nov 14 05:46:36 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:46:36 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:46:36 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47c0714-ce69-426c-b910-8dd180d6e2d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e0e90e-7d78-4a7d-ad78-8e1975ed26e7]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe (non-flash)
Nov 14 05:46:36 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe (non-flash)
Nov 14 05:46:36 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708de1360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f7da8e-76e7-4aa1-b369-97942f91fda7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fadb62-c9bc-48b7-9395-1e21b4043383]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b794818-2ecc-41e0-919d-14569b0ec223]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0de2fe-dd27-417e-b16c-f6dc79680059]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ee6e2b-5544-4eee-a4d3-3cf415c4fa6c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef405d2-c71c-4e60-9a33-77a69cf4070c]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe, portal: 172.16.0.220,3260]
Nov 14 05:46:36 user nova-compute[75469]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe, portal: 172.16.0.220,3260] successful.
Nov 14 05:46:36 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:286fd396-46ad-4bf2-bd00-cde9721864fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[827fb03e-66ae-43c8-8bd7-98eb54e195c3]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] <== disconnect_volume: return (286ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:46:36 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG nova.objects.instance [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'flavor' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5082255a-ac65-4692-9047-f0a17e459b95 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.592s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating instance_info_cache with network_info: [{"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-f07c6e2a-9f27-451f-a173-cf0f9f91f43b" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:46:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:46:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:46:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:46:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:46:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:46:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:46:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:46:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:46:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:46:44 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:46:49 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:46:54 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:46:59 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:47:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:47:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:14 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:47:15 user nova-compute[75469]: INFO nova.compute.manager [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Terminating instance
Nov 14 05:47:15 user nova-compute[75469]: DEBUG nova.compute.manager [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-fef53150-9616-4c2e-8777-6ff1fa0595d4 req-1d4ae741-1656-45a2-b870-33737504d5fb service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Received event network-vif-unplugged-daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fef53150-9616-4c2e-8777-6ff1fa0595d4 req-1d4ae741-1656-45a2-b870-33737504d5fb service nova] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fef53150-9616-4c2e-8777-6ff1fa0595d4 req-1d4ae741-1656-45a2-b870-33737504d5fb service nova] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-fef53150-9616-4c2e-8777-6ff1fa0595d4 req-1d4ae741-1656-45a2-b870-33737504d5fb service nova] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-fef53150-9616-4c2e-8777-6ff1fa0595d4 req-1d4ae741-1656-45a2-b870-33737504d5fb service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] No waiting events found dispatching network-vif-unplugged-daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:47:15 user nova-compute[75469]: DEBUG nova.compute.manager [req-fef53150-9616-4c2e-8777-6ff1fa0595d4 req-1d4ae741-1656-45a2-b870-33737504d5fb service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Received event network-vif-unplugged-daad33a7-5b3e-4503-8eab-473112ae5d68 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:16 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Instance destroyed successfully.
Nov 14 05:47:16 user nova-compute[75469]: DEBUG nova.objects.instance [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lazy-loading 'resources' on Instance uuid f07c6e2a-9f27-451f-a173-cf0f9f91f43b {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1015384604',display_name='tempest-SnapshotDataIntegrityTests-server-1015384604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1015384604',id=52,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi1zkxFuigLxmn9Z2gymk3/fsc7/IHaL0s8F51NhGa9aimiQS8jL1+UYsURHaP0Ba414Kk8ZNDdIQI3u45z2mij0VkH5d9LiS/aRDL7hkILxHzM7fs/T7XGaeJlAeqPow==',key_name='tempest-keypair-1617396323',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53d127f0c81247ed8b4582539bd32014',ramdisk_id='',reservation_id='r-l0adaidt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1229495854',owner_user_name='tempest-SnapshotDataIntegrityTests-1229495854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:41:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a4852497c6e4d4f9440c276506dcc23',uuid=f07c6e2a-9f27-451f-a173-cf0f9f91f43b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Converting VIF {"id": "daad33a7-5b3e-4503-8eab-473112ae5d68", "address": "fa:16:3e:eb:6e:37", "network": {"id": "f8cab145-05fd-4867-b119-f83581c06f7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176689411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53d127f0c81247ed8b4582539bd32014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaad33a7-5b", "ovs_interfaceid": "daad33a7-5b3e-4503-8eab-473112ae5d68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:6e:37,bridge_name='br-int',has_traffic_filtering=True,id=daad33a7-5b3e-4503-8eab-473112ae5d68,network=Network(f8cab145-05fd-4867-b119-f83581c06f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaad33a7-5b') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG os_vif [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:6e:37,bridge_name='br-int',has_traffic_filtering=True,id=daad33a7-5b3e-4503-8eab-473112ae5d68,network=Network(f8cab145-05fd-4867-b119-f83581c06f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaad33a7-5b') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaad33a7-5b, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d67b09e8-54b5-4354-a240-21462cd59203) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:47:16 user nova-compute[75469]: INFO os_vif [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:6e:37,bridge_name='br-int',has_traffic_filtering=True,id=daad33a7-5b3e-4503-8eab-473112ae5d68,network=Network(f8cab145-05fd-4867-b119-f83581c06f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaad33a7-5b')
Nov 14 05:47:16 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Deleting instance files /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b_del
Nov 14 05:47:16 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Deletion of /opt/stack/data/nova/instances/f07c6e2a-9f27-451f-a173-cf0f9f91f43b_del complete
Nov 14 05:47:16 user nova-compute[75469]: INFO nova.compute.manager [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 14 05:47:16 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:47:16 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:47:17 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:47:17 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Took 0.78 seconds to deallocate network for instance.
Nov 14 05:47:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-213ec14b-2562-40c0-ae32-4a24f1a2e446 req-082c9fe5-63de-4802-80af-556f365bac78 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Received event network-vif-deleted-daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:47:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:47:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:47:17 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:47:17 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:47:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:47:17 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Deleted allocations for instance f07c6e2a-9f27-451f-a173-cf0f9f91f43b
Nov 14 05:47:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-cec14713-7b19-4643-9499-3adc2043ebe2 tempest-SnapshotDataIntegrityTests-1229495854 tempest-SnapshotDataIntegrityTests-1229495854-project-member] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.132s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:47:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-bca4e625-8330-46d8-9bd7-07a5496d4c03 req-d2145ad2-0e27-4bc1-8ef6-9cf37b2b12c0 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Received event network-vif-plugged-daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:47:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bca4e625-8330-46d8-9bd7-07a5496d4c03 req-d2145ad2-0e27-4bc1-8ef6-9cf37b2b12c0 service nova] Acquiring lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:47:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bca4e625-8330-46d8-9bd7-07a5496d4c03 req-d2145ad2-0e27-4bc1-8ef6-9cf37b2b12c0 service nova] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:47:17 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-bca4e625-8330-46d8-9bd7-07a5496d4c03 req-d2145ad2-0e27-4bc1-8ef6-9cf37b2b12c0 service nova] Lock "f07c6e2a-9f27-451f-a173-cf0f9f91f43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:47:17 user nova-compute[75469]: DEBUG nova.compute.manager [req-bca4e625-8330-46d8-9bd7-07a5496d4c03 req-d2145ad2-0e27-4bc1-8ef6-9cf37b2b12c0 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] No waiting events found dispatching network-vif-plugged-daad33a7-5b3e-4503-8eab-473112ae5d68 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:47:17 user nova-compute[75469]: WARNING nova.compute.manager [req-bca4e625-8330-46d8-9bd7-07a5496d4c03 req-d2145ad2-0e27-4bc1-8ef6-9cf37b2b12c0 service nova] [instance: f07c6e2a-9f27-451f-a173-cf0f9f91f43b] Received unexpected event network-vif-plugged-daad33a7-5b3e-4503-8eab-473112ae5d68 for instance with vm_state deleted and task_state None.
Nov 14 05:47:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:26 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:47:26 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:47:26 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9173MB free_disk=24.914520263671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:47:26 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:47:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:47:36 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:47:37 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:47:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:47:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:47:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 05:47:37 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:47:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:47:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:47:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:47:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:47:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:47:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:47:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:47:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:47:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:47:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:08 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:09 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:48:28 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:48:28 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9241MB free_disk=24.92111587524414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:48:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:48:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:37 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:48:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:48:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:48:37 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 05:48:37 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:48:37 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:48:39 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:48:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:48:40 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:48:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:42 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:48:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:48:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:48:46 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:48:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:48 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Starting instance... {{(pid=75469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 05:48:53 user nova-compute[75469]: INFO nova.compute.claims [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Claim successful on node user
Nov 14 05:48:53 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Start building networks asynchronously for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Allocating IP information in the background. {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] allocate_for_instance() {{(pid=75469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 05:48:53 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 05:48:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Start building block device mappings for instance. {{(pid=75469) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG nova.policy [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6c38ad94a574b419bc76754a85dd2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf654e161df49cc8664ae34a33594b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75469) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Start spawning the instance on the hypervisor. {{(pid=75469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Creating instance directory {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 05:48:53 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Creating image(s)
Nov 14 05:48:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "/opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "/opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "/opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:48:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.201s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "44f9122883676232a0c9efb4788377a1723d86d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.225s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk 1073741824 {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2,backing_fmt=raw /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk 1073741824" returned: 0 in 0.070s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "44f9122883676232a0c9efb4788377a1723d86d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44f9122883676232a0c9efb4788377a1723d86d2 --force-share --output=json" returned: 0 in 0.206s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk. size=1073741824 {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Successfully created port: 77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG nova.virt.disk.api [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Cannot resize image /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk to a smaller size. {{(pid=75469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Created local disks {{(pid=75469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Ensure instance console log exists: /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/console.log {{(pid=75469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:48:54 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:48:55 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Successfully updated port: 77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 05:48:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:48:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquired lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:48:55 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Building network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 05:48:55 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Instance cache missing network info. {{(pid=75469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 05:48:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-630a8365-156c-46e7-b6df-1d9852dce363 req-ed4d0446-83b4-4812-9c81-cb31d7e17261 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Received event network-changed-77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:48:55 user nova-compute[75469]: DEBUG nova.compute.manager [req-630a8365-156c-46e7-b6df-1d9852dce363 req-ed4d0446-83b4-4812-9c81-cb31d7e17261 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Refreshing instance network info cache due to event network-changed-77acf320-5057-4405-b693-d71a1cff30d9. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:48:55 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-630a8365-156c-46e7-b6df-1d9852dce363 req-ed4d0446-83b4-4812-9c81-cb31d7e17261 service nova] Acquiring lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.network.neutron [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating instance_info_cache with network_info: [{"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Releasing lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Instance network_info: |[{"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-630a8365-156c-46e7-b6df-1d9852dce363 req-ed4d0446-83b4-4812-9c81-cb31d7e17261 service nova] Acquired lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.network.neutron [req-630a8365-156c-46e7-b6df-1d9852dce363 req-ed4d0446-83b4-4812-9c81-cb31d7e17261 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Refreshing network info cache for port 77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Start _get_guest_xml network_info=[{"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '7b828d08-5de0-47b5-a30d-5095d166987a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 05:48:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:48:56 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] CPU controller missing on host. {{(pid=75469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.host [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] CPU controller found on host. {{(pid=75469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T04:47:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T04:48:07Z,direct_url=<?>,disk_format='qcow2',id=7b828d08-5de0-47b5-a30d-5095d166987a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f70bea45417a48dfbf060641403e50f9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T04:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Flavor limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Image limits 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Flavor pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Image pref 0:0:0 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Got 1 possible topologies {{(pid=75469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.hardware [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1731532525',display_name='tempest-SnapshotDataIntegrityTests-server-1731532525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1731532525',id=53,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEutSWaKDrmpRKeTJLtyjgCxxG2/vrdD3HV54p50XQkNgnKwsoSzmzvKsQp+O/1x2CW5Mv4kaEEgJVf8bb7YByzpoLTwYL2QHcMeIXH4n5G9M6dtX3hHfYWuMsUisTm5bQ==',key_name='tempest-keypair-691528237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bf654e161df49cc8664ae34a33594b6',ramdisk_id='',reservation_id='r-np64q2r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2028869202',owner_user_name='tempest-SnapshotDataIntegrityTests-2028869202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6c38ad94a574b419bc76754a85dd2b6',uuid=213f5f75-c34f-41bc-b191-ebca9eb41623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Converting VIF {"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=77acf320-5057-4405-b693-d71a1cff30d9,network=Network(f2168821-0835-46aa-9739-3285e556165f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77acf320-50') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.objects.instance [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'pci_devices' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] End _get_guest_xml xml=<domain type="kvm">
Nov 14 05:48:56 user nova-compute[75469]:   <uuid>213f5f75-c34f-41bc-b191-ebca9eb41623</uuid>
Nov 14 05:48:56 user nova-compute[75469]:   <name>instance-00000035</name>
Nov 14 05:48:56 user nova-compute[75469]:   <memory>524288</memory>
Nov 14 05:48:56 user nova-compute[75469]:   <vcpu>1</vcpu>
Nov 14 05:48:56 user nova-compute[75469]:   <metadata>
Nov 14 05:48:56 user nova-compute[75469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 05:48:56 user nova-compute[75469]:       <nova:package version="0.0.0"/>
Nov 14 05:48:56 user nova-compute[75469]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1731532525</nova:name>
Nov 14 05:48:56 user nova-compute[75469]:       <nova:creationTime>2023-11-14 05:48:56</nova:creationTime>
Nov 14 05:48:56 user nova-compute[75469]:       <nova:flavor name="m1.tiny">
Nov 14 05:48:56 user nova-compute[75469]:         <nova:memory>512</nova:memory>
Nov 14 05:48:56 user nova-compute[75469]:         <nova:disk>1</nova:disk>
Nov 14 05:48:56 user nova-compute[75469]:         <nova:swap>0</nova:swap>
Nov 14 05:48:56 user nova-compute[75469]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 05:48:56 user nova-compute[75469]:         <nova:vcpus>1</nova:vcpus>
Nov 14 05:48:56 user nova-compute[75469]:       </nova:flavor>
Nov 14 05:48:56 user nova-compute[75469]:       <nova:owner>
Nov 14 05:48:56 user nova-compute[75469]:         <nova:user uuid="d6c38ad94a574b419bc76754a85dd2b6">tempest-SnapshotDataIntegrityTests-2028869202-project-member</nova:user>
Nov 14 05:48:56 user nova-compute[75469]:         <nova:project uuid="6bf654e161df49cc8664ae34a33594b6">tempest-SnapshotDataIntegrityTests-2028869202</nova:project>
Nov 14 05:48:56 user nova-compute[75469]:       </nova:owner>
Nov 14 05:48:56 user nova-compute[75469]:       <nova:root type="image" uuid="7b828d08-5de0-47b5-a30d-5095d166987a"/>
Nov 14 05:48:56 user nova-compute[75469]:       <nova:ports>
Nov 14 05:48:56 user nova-compute[75469]:         <nova:port uuid="77acf320-5057-4405-b693-d71a1cff30d9">
Nov 14 05:48:56 user nova-compute[75469]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 05:48:56 user nova-compute[75469]:         </nova:port>
Nov 14 05:48:56 user nova-compute[75469]:       </nova:ports>
Nov 14 05:48:56 user nova-compute[75469]:     </nova:instance>
Nov 14 05:48:56 user nova-compute[75469]:   </metadata>
Nov 14 05:48:56 user nova-compute[75469]:   <sysinfo type="smbios">
Nov 14 05:48:56 user nova-compute[75469]:     <system>
Nov 14 05:48:56 user nova-compute[75469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 05:48:56 user nova-compute[75469]:       <entry name="product">OpenStack Nova</entry>
Nov 14 05:48:56 user nova-compute[75469]:       <entry name="version">0.0.0</entry>
Nov 14 05:48:56 user nova-compute[75469]:       <entry name="serial">213f5f75-c34f-41bc-b191-ebca9eb41623</entry>
Nov 14 05:48:56 user nova-compute[75469]:       <entry name="uuid">213f5f75-c34f-41bc-b191-ebca9eb41623</entry>
Nov 14 05:48:56 user nova-compute[75469]:       <entry name="family">Virtual Machine</entry>
Nov 14 05:48:56 user nova-compute[75469]:     </system>
Nov 14 05:48:56 user nova-compute[75469]:   </sysinfo>
Nov 14 05:48:56 user nova-compute[75469]:   <os>
Nov 14 05:48:56 user nova-compute[75469]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 05:48:56 user nova-compute[75469]:     <boot dev="hd"/>
Nov 14 05:48:56 user nova-compute[75469]:     <smbios mode="sysinfo"/>
Nov 14 05:48:56 user nova-compute[75469]:   </os>
Nov 14 05:48:56 user nova-compute[75469]:   <features>
Nov 14 05:48:56 user nova-compute[75469]:     <acpi/>
Nov 14 05:48:56 user nova-compute[75469]:     <apic/>
Nov 14 05:48:56 user nova-compute[75469]:     <vmcoreinfo/>
Nov 14 05:48:56 user nova-compute[75469]:   </features>
Nov 14 05:48:56 user nova-compute[75469]:   <clock offset="utc">
Nov 14 05:48:56 user nova-compute[75469]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 05:48:56 user nova-compute[75469]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 05:48:56 user nova-compute[75469]:     <timer name="hpet" present="no"/>
Nov 14 05:48:56 user nova-compute[75469]:   </clock>
Nov 14 05:48:56 user nova-compute[75469]:   <cpu mode="custom" match="exact">
Nov 14 05:48:56 user nova-compute[75469]:     <model>Nehalem</model>
Nov 14 05:48:56 user nova-compute[75469]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 05:48:56 user nova-compute[75469]:   </cpu>
Nov 14 05:48:56 user nova-compute[75469]:   <devices>
Nov 14 05:48:56 user nova-compute[75469]:     <disk type="file" device="disk">
Nov 14 05:48:56 user nova-compute[75469]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 05:48:56 user nova-compute[75469]:       <source file="/opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk"/>
Nov 14 05:48:56 user nova-compute[75469]:       <target dev="vda" bus="virtio"/>
Nov 14 05:48:56 user nova-compute[75469]:     </disk>
Nov 14 05:48:56 user nova-compute[75469]:     <interface type="ethernet">
Nov 14 05:48:56 user nova-compute[75469]:       <mac address="fa:16:3e:cf:c9:1a"/>
Nov 14 05:48:56 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:48:56 user nova-compute[75469]:       <mtu size="1442"/>
Nov 14 05:48:56 user nova-compute[75469]:       <target dev="tap77acf320-50"/>
Nov 14 05:48:56 user nova-compute[75469]:     </interface>
Nov 14 05:48:56 user nova-compute[75469]:     <serial type="pty">
Nov 14 05:48:56 user nova-compute[75469]:       <log file="/opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/console.log" append="off"/>
Nov 14 05:48:56 user nova-compute[75469]:     </serial>
Nov 14 05:48:56 user nova-compute[75469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 05:48:56 user nova-compute[75469]:     <video>
Nov 14 05:48:56 user nova-compute[75469]:       <model type="virtio"/>
Nov 14 05:48:56 user nova-compute[75469]:     </video>
Nov 14 05:48:56 user nova-compute[75469]:     <rng model="virtio">
Nov 14 05:48:56 user nova-compute[75469]:       <backend model="random">/dev/urandom</backend>
Nov 14 05:48:56 user nova-compute[75469]:     </rng>
Nov 14 05:48:56 user nova-compute[75469]:     <controller type="usb" index="0" model="none"/>
Nov 14 05:48:56 user nova-compute[75469]:     <memballoon model="virtio">
Nov 14 05:48:56 user nova-compute[75469]:       <stats period="10"/>
Nov 14 05:48:56 user nova-compute[75469]:     </memballoon>
Nov 14 05:48:56 user nova-compute[75469]:   </devices>
Nov 14 05:48:56 user nova-compute[75469]: </domain>
Nov 14 05:48:56 user nova-compute[75469]:  {{(pid=75469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1731532525',display_name='tempest-SnapshotDataIntegrityTests-server-1731532525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1731532525',id=53,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEutSWaKDrmpRKeTJLtyjgCxxG2/vrdD3HV54p50XQkNgnKwsoSzmzvKsQp+O/1x2CW5Mv4kaEEgJVf8bb7YByzpoLTwYL2QHcMeIXH4n5G9M6dtX3hHfYWuMsUisTm5bQ==',key_name='tempest-keypair-691528237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bf654e161df49cc8664ae34a33594b6',ramdisk_id='',reservation_id='r-np64q2r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2028869202',owner_user_name='tempest-SnapshotDataIntegrityTests-2028869202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T05:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6c38ad94a574b419bc76754a85dd2b6',uuid=213f5f75-c34f-41bc-b191-ebca9eb41623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Converting VIF {"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=77acf320-5057-4405-b693-d71a1cff30d9,network=Network(f2168821-0835-46aa-9739-3285e556165f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77acf320-50') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG os_vif [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=77acf320-5057-4405-b693-d71a1cff30d9,network=Network(f2168821-0835-46aa-9739-3285e556165f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77acf320-50') {{(pid=75469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9ac087f-4a33-50df-8496-a9e6af8014ec', '_type': 'linux-noop'}}, row=False) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77acf320-50, may_exist=True, interface_attrs={}) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77acf320-50, col_values=(('qos', UUID('834d3763-8635-4ea0-949f-1b7ff2f8e2c0')),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77acf320-50, col_values=(('external_ids', {'iface-id': '77acf320-5057-4405-b693-d71a1cff30d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:c9:1a', 'vm-uuid': '213f5f75-c34f-41bc-b191-ebca9eb41623'}),), if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:56 user nova-compute[75469]: INFO os_vif [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=77acf320-5057-4405-b693-d71a1cff30d9,network=Network(f2168821-0835-46aa-9739-3285e556165f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77acf320-50')
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No VIF found with MAC fa:16:3e:cf:c9:1a, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.network.neutron [req-630a8365-156c-46e7-b6df-1d9852dce363 req-ed4d0446-83b4-4812-9c81-cb31d7e17261 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updated VIF entry in instance network info cache for port 77acf320-5057-4405-b693-d71a1cff30d9. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG nova.network.neutron [req-630a8365-156c-46e7-b6df-1d9852dce363 req-ed4d0446-83b4-4812-9c81-cb31d7e17261 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating instance_info_cache with network_info: [{"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:48:56 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-630a8365-156c-46e7-b6df-1d9852dce363 req-ed4d0446-83b4-4812-9c81-cb31d7e17261 service nova] Releasing lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:48:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-1491b0f6-7d22-4fa2-a658-ebd09ee6be17 req-a693dfca-5066-4e73-9f2c-86a70b76c178 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Received event network-vif-plugged-77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:48:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1491b0f6-7d22-4fa2-a658-ebd09ee6be17 req-a693dfca-5066-4e73-9f2c-86a70b76c178 service nova] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:48:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1491b0f6-7d22-4fa2-a658-ebd09ee6be17 req-a693dfca-5066-4e73-9f2c-86a70b76c178 service nova] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:48:58 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-1491b0f6-7d22-4fa2-a658-ebd09ee6be17 req-a693dfca-5066-4e73-9f2c-86a70b76c178 service nova] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:48:58 user nova-compute[75469]: DEBUG nova.compute.manager [req-1491b0f6-7d22-4fa2-a658-ebd09ee6be17 req-a693dfca-5066-4e73-9f2c-86a70b76c178 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] No waiting events found dispatching network-vif-plugged-77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:48:58 user nova-compute[75469]: WARNING nova.compute.manager [req-1491b0f6-7d22-4fa2-a658-ebd09ee6be17 req-a693dfca-5066-4e73-9f2c-86a70b76c178 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Received unexpected event network-vif-plugged-77acf320-5057-4405-b693-d71a1cff30d9 for instance with vm_state building and task_state spawning.
Nov 14 05:48:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:48:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Instance event wait completed in 0 seconds for  {{(pid=75469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Guest created on hypervisor {{(pid=75469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 05:49:00 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Instance spawned successfully.
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Found default for hw_cdrom_bus of ide {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Found default for hw_disk_bus of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Found default for hw_input_bus of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Found default for hw_pointer_model of None {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Found default for hw_video_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Found default for hw_vif_model of virtio {{(pid=75469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.compute.manager [req-aad91ece-da9e-44d3-b60a-8f92cd2514e8 req-72fb14c0-73df-4aa7-9117-c64921fe1f58 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Received event network-vif-plugged-77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aad91ece-da9e-44d3-b60a-8f92cd2514e8 req-72fb14c0-73df-4aa7-9117-c64921fe1f58 service nova] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aad91ece-da9e-44d3-b60a-8f92cd2514e8 req-72fb14c0-73df-4aa7-9117-c64921fe1f58 service nova] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-aad91ece-da9e-44d3-b60a-8f92cd2514e8 req-72fb14c0-73df-4aa7-9117-c64921fe1f58 service nova] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.compute.manager [req-aad91ece-da9e-44d3-b60a-8f92cd2514e8 req-72fb14c0-73df-4aa7-9117-c64921fe1f58 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] No waiting events found dispatching network-vif-plugged-77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:49:00 user nova-compute[75469]: WARNING nova.compute.manager [req-aad91ece-da9e-44d3-b60a-8f92cd2514e8 req-72fb14c0-73df-4aa7-9117-c64921fe1f58 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Received unexpected event network-vif-plugged-77acf320-5057-4405-b693-d71a1cff30d9 for instance with vm_state building and task_state spawning.
Nov 14 05:49:00 user nova-compute[75469]: INFO nova.compute.manager [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 14 05:49:00 user nova-compute[75469]: DEBUG nova.compute.manager [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Checking state {{(pid=75469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 05:49:00 user nova-compute[75469]: INFO nova.compute.manager [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Took 6.87 seconds to build instance.
Nov 14 05:49:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-a1d47db5-c53d-4eb9-b8f5-7a0b878e6f1e tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.014s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:49:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:03 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 05:49:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 05:49:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:49:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:49:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:49:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:49:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:49:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:12 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:22 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:24 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:24 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 05:49:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:27 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:49:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:49:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:49:28 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:49:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:49:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:49:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:49:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:49:28 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:49:28 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:49:28 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=24.869415283203125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:49:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:49:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:49:29 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 213f5f75-c34f-41bc-b191-ebca9eb41623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:49:29 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:49:29 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:49:29 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:49:29 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:49:29 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:49:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:49:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:32 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating instance_info_cache with network_info: [{"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:38 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:40 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:49:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:49:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:42 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Triggering sync for uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 05:49:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:49:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:49:42 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:49:45 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:46 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:49:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:49:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:49:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:49:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:49:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:47 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:49:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:49:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:49:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:49:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:49:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:49:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:49:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:50:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:50:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:50:08 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:50:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:50:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:50:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:50:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:50:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:50:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:28 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:50:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:50:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:50:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:50:28 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:50:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:28 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:28 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:50:28 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:50:28 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9017MB free_disk=24.86865234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:50:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:50:28 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:50:29 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 213f5f75-c34f-41bc-b191-ebca9eb41623 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:50:29 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:50:29 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:50:29 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:50:29 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:50:29 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:50:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:50:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:50:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:50:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:38 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:50:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:50:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:50:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:50:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:50:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:50:38 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:50:38 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating instance_info_cache with network_info: [{"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:50:38 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:50:38 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:50:38 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:50:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:50:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:50:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:50:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:50:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:50:42 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:50:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:50:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-5ae5be72-70c6-4071-b0b7-30d486c54ee1 req-4ccf718c-abb6-4575-8050-c28086d3564b service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Received event network-changed-77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:50:44 user nova-compute[75469]: DEBUG nova.compute.manager [req-5ae5be72-70c6-4071-b0b7-30d486c54ee1 req-4ccf718c-abb6-4575-8050-c28086d3564b service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Refreshing instance network info cache due to event network-changed-77acf320-5057-4405-b693-d71a1cff30d9. {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 05:50:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5ae5be72-70c6-4071-b0b7-30d486c54ee1 req-4ccf718c-abb6-4575-8050-c28086d3564b service nova] Acquiring lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:50:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5ae5be72-70c6-4071-b0b7-30d486c54ee1 req-4ccf718c-abb6-4575-8050-c28086d3564b service nova] Acquired lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:50:44 user nova-compute[75469]: DEBUG nova.network.neutron [req-5ae5be72-70c6-4071-b0b7-30d486c54ee1 req-4ccf718c-abb6-4575-8050-c28086d3564b service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Refreshing network info cache for port 77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 05:50:44 user nova-compute[75469]: DEBUG nova.network.neutron [req-5ae5be72-70c6-4071-b0b7-30d486c54ee1 req-4ccf718c-abb6-4575-8050-c28086d3564b service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updated VIF entry in instance network info cache for port 77acf320-5057-4405-b693-d71a1cff30d9. {{(pid=75469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 05:50:44 user nova-compute[75469]: DEBUG nova.network.neutron [req-5ae5be72-70c6-4071-b0b7-30d486c54ee1 req-4ccf718c-abb6-4575-8050-c28086d3564b service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating instance_info_cache with network_info: [{"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:50:44 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-5ae5be72-70c6-4071-b0b7-30d486c54ee1 req-4ccf718c-abb6-4575-8050-c28086d3564b service nova] Releasing lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:50:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:50:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:50:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:50:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:50:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:50:46 user nova-compute[75469]: DEBUG nova.objects.instance [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:50:46 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:50:47 user nova-compute[75469]: INFO nova.compute.manager [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attaching volume 2ba700bd-5936-48d3-85e4-3fff8e4923cb to /dev/vdb
Nov 14 05:50:47 user nova-compute[75469]: DEBUG os_brick.utils [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a910ada-9c45-4277-a9c3-b52d37401964]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db0f594-6ea6-4fd1-a1bd-a4f62f6bf940]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdcef6b-d33f-4da4-90da-9b6679d15856]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2fdb2e-f906-4094-aad6-931d319584ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:50:47 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:50:47 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f2e54e-dfa4-44f6-b843-20aea1357457]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG os_brick.utils [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating existing volume attachment record: 7d381c23-f2c9-4139-8fac-d23d6d62ceba {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:50:47 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:48 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:50:48 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMJnvVji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:50:51 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:50:51 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:50:51 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1270cbe0-80dd-41d5-909d-c30a31c13993]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:50:51 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf7af9d-24ac-47e2-ae09-0b84b4b03d13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb] added
Nov 14 05:50:51 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e101206b-e539-4b9b-ab69-73b2351ad3b8]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[685b6290-cbcb-4dad-980d-5a7bbee02e80]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMJnvVji {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMJnvVji" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb3d4cc-71ee-4311-82d3-fec87a866592]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xMJnvVji'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0b1b9b-8032-48e5-a1d6-36fa1895d0f4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec81e442-14b2-47b1-90ad-0e5be971317c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:50:51 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:50:51 user nova-compute[75469]:  {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:50:51 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 05:50:51 user nova-compute[75469]: 
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf7e8aa-5e55-4b68-8a3e-d5db52660d8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb, portal: 172.16.0.220,3260]
Nov 14 05:50:51 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb, portal: 172.16.0.220,3260] successful.
Nov 14 05:50:51 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[97959e6c-9e8f-440f-be22-17be6146203d]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fced5d71-6fd8-4b5c-b368-615fe74371e1]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb (non-flash)
Nov 14 05:50:51 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb (non-flash)
Nov 14 05:50:51 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[006a652d-a297-4bff-9545-ba070810f6cc]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:50:51 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:50:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:52 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:50:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMJnvVji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:50:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:50:52 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26437396133326664', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:50:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437396133326664', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:50:52 user nova-compute[75469]: DEBUG nova.objects.instance [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:50:52 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:50:52 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:50:52 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:50:52 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:50:52 user nova-compute[75469]:   <serial>2ba700bd-5936-48d3-85e4-3fff8e4923cb</serial>
Nov 14 05:50:52 user nova-compute[75469]: </disk>
Nov 14 05:50:52 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:50:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:50:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:50:53 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No VIF found with MAC fa:16:3e:cf:c9:1a, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:50:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-49646fd0-40f0-42c9-a5f0-5fa49096996a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.004s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:50:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:50:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:51:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:51:00 user nova-compute[75469]: INFO nova.compute.manager [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Detaching volume 2ba700bd-5936-48d3-85e4-3fff8e4923cb
Nov 14 05:51:00 user nova-compute[75469]: INFO nova.virt.block_device [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attempting to driver detach volume 2ba700bd-5936-48d3-85e4-3fff8e4923cb from mountpoint /dev/vdb
Nov 14 05:51:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Attempting to detach device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:51:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:51:00 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:51:00 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:51:00 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:51:00 user nova-compute[75469]:   <serial>2ba700bd-5936-48d3-85e4-3fff8e4923cb</serial>
Nov 14 05:51:00 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:51:00 user nova-compute[75469]: </disk>
Nov 14 05:51:00 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:51:00 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Successfully detached device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the persistent domain config.
Nov 14 05:51:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:51:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:51:00 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:51:00 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:51:00 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:51:00 user nova-compute[75469]:   <serial>2ba700bd-5936-48d3-85e4-3fff8e4923cb</serial>
Nov 14 05:51:00 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:51:00 user nova-compute[75469]: </disk>
Nov 14 05:51:00 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:51:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:51:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:51:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:51:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:51:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:51:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:51:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:51:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:51:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:51:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:17 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:21 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 is timed out.
Nov 14 05:51:21 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Successfully detached device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the live domain config.
Nov 14 05:51:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMJnvVji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:51:21 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce797c-4b04-4bec-9ce6-922fa4c10bb0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:51:21 user nova-compute[75469]: No targets found.
Nov 14 05:51:21 user nova-compute[75469]: iSNS:
Nov 14 05:51:21 user nova-compute[75469]: No targets found.
Nov 14 05:51:21 user nova-compute[75469]: STATIC:
Nov 14 05:51:21 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb
Nov 14 05:51:21 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:51:21 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:51:21 user nova-compute[75469]: FIRMWARE:
Nov 14 05:51:21 user nova-compute[75469]: No targets found.
Nov 14 05:51:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:51:21 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:51:21 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0e5468-3509-4193-8933-41099e47dd46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8155359e-c4e4-4b7c-94e9-c238e5c1f848]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb (non-flash)
Nov 14 05:51:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb (non-flash)
Nov 14 05:51:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c3d7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dd4d6a-e499-43b3-97df-7ff89c1e3e72]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdbe7c7-27e7-4eaf-8de2-3cb366f495f7]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af81518-4cdc-426d-aaf7-2ae949cf298c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91915ca-97f3-4c24-b92d-43a1bdc8afd2]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef5c3d6-ca79-4d68-942a-a541e71d6d05]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9893e9c0-b065-4436-9cd6-d0c4890bba6e]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb, portal: 172.16.0.220,3260]
Nov 14 05:51:21 user nova-compute[75469]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb, portal: 172.16.0.220,3260] successful.
Nov 14 05:51:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba700bd-5936-48d3-85e4-3fff8e4923cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20a4969-029e-423a-b3bb-97b02fc538f4]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== disconnect_volume: return (312ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:51:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:51:22 user nova-compute[75469]: DEBUG nova.objects.instance [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:51:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-78459052-5de1-46c2-8c08-3efe47177810 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.618s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:51:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:29 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:51:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:51:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:51:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:51:29 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:51:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:29 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:51:29 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:51:29 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=24.867279052734375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:51:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:51:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:51:30 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 213f5f75-c34f-41bc-b191-ebca9eb41623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:51:30 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:51:30 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:51:30 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:51:30 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:51:30 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:51:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:51:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:51:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:51:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:51:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:51:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:51:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:51:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:51:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:51:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:51:39 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:51:39 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:51:39 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating instance_info_cache with network_info: [{"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:51:39 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:51:39 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:51:39 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:51:40 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:51:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:51:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:51:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:51:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:51:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:51:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:51:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:51:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:47 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:51:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:51:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:51:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:51:52 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:51:52 user nova-compute[75469]: DEBUG nova.objects.instance [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:51:52 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:51:53 user nova-compute[75469]: INFO nova.compute.manager [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attaching volume 361fdef9-79e2-4b67-84e7-c09e55556f94 to /dev/vdb
Nov 14 05:51:53 user nova-compute[75469]: DEBUG os_brick.utils [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a04edd-7cbc-4945-bff5-7201894e3a46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e00f5a-69bf-4562-8c51-056ccb7f1aa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0108dd86-565d-4b11-b8dc-aaae4c691d65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fb3115-8a88-49be-8d5a-22f67669f78d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:51:53 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:51:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8d379d-2c79-4780-822d-de2e8f4d06a2]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG os_brick.utils [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:51:53 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating existing volume attachment record: 31e0a3aa-6af7-49b1-a8f4-5d44589b4529 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:51:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhFJfuvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:51:57 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:51:57 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:51:57 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f441eac4-5c6c-4f1d-97b3-ad14eb0db444]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:51:57 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b6f186-c74d-4a69-ab6e-7888eb0112f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94] added
Nov 14 05:51:57 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c722ed1-69c6-43c7-859c-6900d5a8aa8e]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b11d8f-4ee6-4ced-96c6-3018ccd55915]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhFJfuvz {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhFJfuvz" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e528f81-52e4-484c-acb4-857f42336b75]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IhFJfuvz'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c37329-1480-44c7-bc29-548c124e3d90]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[422f49ec-0316-4059-996d-56ca03855740]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:51:57 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:51:57 user nova-compute[75469]:  {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:51:57 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 05:51:57 user nova-compute[75469]: 
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e21eec4-0e3e-428d-a13a-f785b2fa8b76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94, portal: 172.16.0.220,3260]
Nov 14 05:51:57 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94, portal: 172.16.0.220,3260] successful.
Nov 14 05:51:57 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[459a14df-9f76-49f9-90a8-67ede928c78f]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e8426-9bfa-4d25-a685-648002255492]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 (non-flash)
Nov 14 05:51:57 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 (non-flash)
Nov 14 05:51:57 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe619f3-a6d7-4ef3-8a44-f76e377cac70]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:51:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhFJfuvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:51:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:51:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26361356434313032', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:51:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361356434313032', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:51:58 user nova-compute[75469]: DEBUG nova.objects.instance [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:51:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:51:58 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:51:58 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:51:58 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:51:58 user nova-compute[75469]:   <serial>361fdef9-79e2-4b67-84e7-c09e55556f94</serial>
Nov 14 05:51:58 user nova-compute[75469]: </disk>
Nov 14 05:51:58 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:51:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No VIF found with MAC fa:16:3e:cf:c9:1a, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:51:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-72170ec8-0f8e-4637-a411-5bf861120f9d tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.119s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:52:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:52:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:52:01 user nova-compute[75469]: INFO nova.compute.manager [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Detaching volume 361fdef9-79e2-4b67-84e7-c09e55556f94
Nov 14 05:52:01 user nova-compute[75469]: INFO nova.virt.block_device [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attempting to driver detach volume 361fdef9-79e2-4b67-84e7-c09e55556f94 from mountpoint /dev/vdb
Nov 14 05:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Attempting to detach device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:52:01 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:52:01 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:52:01 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:52:01 user nova-compute[75469]:   <serial>361fdef9-79e2-4b67-84e7-c09e55556f94</serial>
Nov 14 05:52:01 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:52:01 user nova-compute[75469]: </disk>
Nov 14 05:52:01 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:52:01 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Successfully detached device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the persistent domain config.
Nov 14 05:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:52:01 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:52:01 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:52:01 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:52:01 user nova-compute[75469]:   <serial>361fdef9-79e2-4b67-84e7-c09e55556f94</serial>
Nov 14 05:52:01 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:52:01 user nova-compute[75469]: </disk>
Nov 14 05:52:01 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:52:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:52:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:52:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:52:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:52:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:52:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:52:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:21 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 is timed out.
Nov 14 05:52:21 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Successfully detached device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the live domain config.
Nov 14 05:52:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhFJfuvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:52:21 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2d5cc7-5659-477d-8113-d9fc2513004a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:52:21 user nova-compute[75469]: No targets found.
Nov 14 05:52:21 user nova-compute[75469]: iSNS:
Nov 14 05:52:21 user nova-compute[75469]: No targets found.
Nov 14 05:52:21 user nova-compute[75469]: STATIC:
Nov 14 05:52:21 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94
Nov 14 05:52:21 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:52:21 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:52:21 user nova-compute[75469]: FIRMWARE:
Nov 14 05:52:21 user nova-compute[75469]: No targets found.
Nov 14 05:52:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:52:21 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:52:21 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8eaff2-6b07-4353-8ea5-795caa18b3b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff47f528-d138-4a9e-a9d0-cc3703aceacc]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 (non-flash)
Nov 14 05:52:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 (non-flash)
Nov 14 05:52:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa708f5ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b68106-3d47-41e0-b9f6-22b81e6c2d9f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb14b3d9-5b4b-47bc-8694-ecb336d502df]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df2daa5-1692-4d53-a96a-de7c2f219577]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e109fa73-1209-4e2e-8f72-28eed6e58409]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5ae9ed-5324-4fe6-ac8f-3e75808dcae6]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d373e7a5-bbb6-4579-8c55-397b74223aeb]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94, portal: 172.16.0.220,3260]
Nov 14 05:52:21 user nova-compute[75469]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94, portal: 172.16.0.220,3260] successful.
Nov 14 05:52:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fdef9-79e2-4b67-84e7-c09e55556f94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[966abb7d-73ac-40b4-aa22-3cb15e02f9fb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== disconnect_volume: return (307ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:52:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:52:22 user nova-compute[75469]: DEBUG nova.objects.instance [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:52:22 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-609a7519-edaf-4265-95e9-369c0c50d45a tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.643s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:52:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:52:29 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:52:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:52:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:52:29 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:52:29 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:52:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:29 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:52:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:52:30 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=24.866344451904297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:52:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:52:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:52:30 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 213f5f75-c34f-41bc-b191-ebca9eb41623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:52:30 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:52:30 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:52:30 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:52:30 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:52:30 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:52:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:52:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:52:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:52:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:52:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:52:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating instance_info_cache with network_info: [{"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:52:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:52:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:52:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:52:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:52:44 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:52:45 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:52:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:49 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:52:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:52:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:52:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:52:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:52:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:52:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:52:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG nova.objects.instance [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:52:53 user nova-compute[75469]: INFO nova.compute.manager [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attaching volume d912e2cc-f454-445b-8cca-03561d9bde7c to /dev/vdb
Nov 14 05:52:53 user nova-compute[75469]: DEBUG os_brick.utils [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2ae379-e812-4b69-b524-0be59efada92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[110cbf3a-1d83-45b8-85ec-d1328a345ac7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[929961f1-c064-4722-8f60-328f16c62e29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1133a6f1-969d-4406-943b-753fb2096755]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:52:53 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:52:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdad5c0-8c2f-4816-ba08-afea13f6d06a]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG os_brick.utils [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:52:53 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating existing volume attachment record: f49b6705-7cac-469b-92c1-5b72b2d82ffc {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:52:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyidwOEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:52:57 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:52:57 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:52:57 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad5dba3-318d-473e-b34f-7097cf17ce2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:52:57 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd539a1-6a58-465a-a309-a2609f99ba17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c] added
Nov 14 05:52:57 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dbeb4a-4447-4f36-a6e0-2971e0f01e2a]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d655137e-0413-400a-8ab7-4815e7be3dc8]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyidwOEt {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyidwOEt" returned: 0 in 0.022s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde503f5-e70b-4455-968c-eb72071c2c93]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jyidwOEt'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[551e24c9-9762-48c6-841c-701431828d96]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[325699ff-8e7a-4a21-984c-5629682ec987]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:52:57 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:52:57 user nova-compute[75469]:  {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:52:57 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 05:52:57 user nova-compute[75469]: 
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fb01aa-8b1e-40d8-84c8-9e83c69edd1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c, portal: 172.16.0.220,3260]
Nov 14 05:52:57 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c, portal: 172.16.0.220,3260] successful.
Nov 14 05:52:57 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[049f94bb-afed-48e5-9dbb-a7c94afefc24]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[027c0ae9-06f6-47d9-b3ac-87a1ff6a6481]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c (non-flash)
Nov 14 05:52:57 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c (non-flash)
Nov 14 05:52:57 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb898198-f23d-402e-85db-45a771fd43d2]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:52:57 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyidwOEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:52:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:52:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26537353032663235', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:52:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537353032663235', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:52:58 user nova-compute[75469]: DEBUG nova.objects.instance [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:52:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:52:58 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:52:58 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:52:58 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:52:58 user nova-compute[75469]:   <serial>d912e2cc-f454-445b-8cca-03561d9bde7c</serial>
Nov 14 05:52:58 user nova-compute[75469]: </disk>
Nov 14 05:52:58 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:52:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:52:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:52:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No VIF found with MAC fa:16:3e:cf:c9:1a, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:52:59 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-fa36d400-6754-4802-a29a-f9fec2887240 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.972s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:53:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:53:01 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:53:01 user nova-compute[75469]: INFO nova.compute.manager [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Detaching volume d912e2cc-f454-445b-8cca-03561d9bde7c
Nov 14 05:53:01 user nova-compute[75469]: INFO nova.virt.block_device [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attempting to driver detach volume d912e2cc-f454-445b-8cca-03561d9bde7c from mountpoint /dev/vdb
Nov 14 05:53:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Attempting to detach device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:53:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:53:01 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:53:01 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:53:01 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:53:01 user nova-compute[75469]:   <serial>d912e2cc-f454-445b-8cca-03561d9bde7c</serial>
Nov 14 05:53:01 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:53:01 user nova-compute[75469]: </disk>
Nov 14 05:53:01 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:53:01 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Successfully detached device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the persistent domain config.
Nov 14 05:53:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:53:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:53:01 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:53:01 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:53:01 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:53:01 user nova-compute[75469]:   <serial>d912e2cc-f454-445b-8cca-03561d9bde7c</serial>
Nov 14 05:53:01 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:53:01 user nova-compute[75469]: </disk>
Nov 14 05:53:01 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:53:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:01 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:53:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:53:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:53:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:53:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:53:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:53:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:21 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 is timed out.
Nov 14 05:53:21 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Successfully detached device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the live domain config.
Nov 14 05:53:21 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyidwOEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:53:21 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:53:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a70243-82fd-4b2f-905e-098c7054aafe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:53:21 user nova-compute[75469]: No targets found.
Nov 14 05:53:21 user nova-compute[75469]: iSNS:
Nov 14 05:53:21 user nova-compute[75469]: No targets found.
Nov 14 05:53:21 user nova-compute[75469]: STATIC:
Nov 14 05:53:21 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c
Nov 14 05:53:21 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:53:21 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:53:21 user nova-compute[75469]: FIRMWARE:
Nov 14 05:53:21 user nova-compute[75469]: No targets found.
Nov 14 05:53:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:53:21 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:53:21 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a5be58-3ae4-48b9-9f05-3a98c1b35711]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cea8426-00cc-44dc-adbb-696089a3c0ea]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c (non-flash)
Nov 14 05:53:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c (non-flash)
Nov 14 05:53:21 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c3d7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:53:21 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c1a7b7-6679-4bf0-9073-2675409b5479]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f01d8fd-3035-4d63-8a37-be3bcd067f8d]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[525e89fa-c9d9-49ce-9aad-ff449fa5e6ce]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec385c75-dc78-4565-9345-b41291a33aa0]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5176914e-0140-4baf-96b2-4af0a09e8feb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4995aa-1e65-4f8d-aecb-5e2c58d577e6]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c, portal: 172.16.0.220,3260]
Nov 14 05:53:22 user nova-compute[75469]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c, portal: 172.16.0.220,3260] successful.
Nov 14 05:53:22 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d912e2cc-f454-445b-8cca-03561d9bde7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[387f731e-f944-4dd1-9989-a467eb404f59]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== disconnect_volume: return (352ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:53:22 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:53:23 user nova-compute[75469]: DEBUG nova.objects.instance [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:53:23 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-4764cd75-ebfe-47b7-8fe7-4881862d94c8 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.754s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:53:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:53:30 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:53:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:53:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:53:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:53:30 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:53:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:30 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:53:30 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:53:30 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=24.865379333496094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:53:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:53:30 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 213f5f75-c34f-41bc-b191-ebca9eb41623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing inventories for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating ProviderTree inventory for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Updating inventory in ProviderTree for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing aggregate associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, aggregates: None {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Refreshing trait associations for resource provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3 {{(pid=75469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:53:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating instance_info_cache with network_info: [{"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:53:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:53:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:53:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:53:46 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:53:46 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:53:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:53:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:50 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:53:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:53:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:53:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:53:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:53:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:53:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG nova.objects.instance [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:53:53 user nova-compute[75469]: INFO nova.compute.manager [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attaching volume 52e6c2d4-ea56-40a1-a79f-d181197ac348 to /dev/vdb
Nov 14 05:53:53 user nova-compute[75469]: DEBUG os_brick.utils [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a71496-6e41-4050-b3a6-855c3935c16d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b185817322a\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f7e14e-845d-49d8-8834-466345d1e3c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18960f-f60a-4259-9846-5b11a3d7ea0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[608f9254-2bb7-4d95-8110-f022958280a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Running cmd (subprocess): nvme version {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] 'nvme version' failed. Not Retrying. {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] nvme not present on system {{(pid=75469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 05:53:53 user nova-compute[75469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 05:53:53 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[96762b52-f1ec-46f1-ab1b-e7bc76d27369]: (4, '') {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.lightos [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] LIGHTOS: no hostnqn found. {{(pid=75469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG os_brick.utils [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b185817322a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:53:53 user nova-compute[75469]: DEBUG nova.virt.block_device [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating existing volume attachment record: 3088a535-eb6b-4f68-aa3f-b392a66f5a21 {{(pid=75469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 05:53:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:53:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:53:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:53:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:53:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:57 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Calling os-brick to attach iSCSI Volume {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrsYCGIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:53:58 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:53:58 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:53:58 user nova-compute[75469]: INFO os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d253f5-3c18-4444-95b4-70487fb46e77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 05:53:58 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --interface default --op new {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[28447be4-df70-4be4-8df9-419a8dd44544]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348] added\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348] added
Nov 14 05:53:58 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[28624ac3-814c-41f4-b7d9-c93f5dbb6649]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94121289-a093-4ad4-8b38-e1b0219d5cb8]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrsYCGIq {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrsYCGIq" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2304692d-1ec2-4a11-91a9-c4c002e3abad]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SrsYCGIq'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d357b4fd-71e0-4bfb-b3c8-0d32e10df9cb]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[151a6b51-3f90-4ef6-8f84-a726515904a5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:53:58 user nova-compute[75469]:  {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 05:53:58 user nova-compute[75469]:  {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:53:58 user nova-compute[75469]: WARNING os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 05:53:58 user nova-compute[75469]: 
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --login {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d88464-d455-4f0a-af18-a87049ed5d94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348, portal: 172.16.0.220,3260]
Nov 14 05:53:58 user nova-compute[75469]: Login to [iface: default, target: iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348, portal: 172.16.0.220,3260] successful.
Nov 14 05:53:58 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a60ae1-fc91-4dd9-bb44-69997750fb81]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[422f47ec-f4c3-47b3-96fa-3d71364104eb]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 (non-flash)
Nov 14 05:53:58 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 (non-flash)
Nov 14 05:53:58 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Connected to 172.16.0.220:3260 {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[401f4ed0-250c-4a4a-82f5-f51b643b08b9]: (4, ('- - 0', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 05:53:58 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrsYCGIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 05:53:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:53:59 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23162303437373736', 'path': '/dev/sdb'} {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:53:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162303437373736', 'path': '/dev/sdb'} {{(pid=75469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 05:53:59 user nova-compute[75469]: DEBUG nova.objects.instance [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:53:59 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 05:53:59 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:53:59 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:53:59 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:53:59 user nova-compute[75469]:   <serial>52e6c2d4-ea56-40a1-a79f-d181197ac348</serial>
Nov 14 05:53:59 user nova-compute[75469]: </disk>
Nov 14 05:53:59 user nova-compute[75469]:  {{(pid=75469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 05:54:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:54:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 05:54:00 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] No VIF found with MAC fa:16:3e:cf:c9:1a, not building metadata {{(pid=75469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 05:54:00 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-d98e6b65-5f1a-403c-9a85-3091023e2bde tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.611s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:54:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:54:02 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:54:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:54:02 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:54:02 user nova-compute[75469]: INFO nova.compute.manager [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Detaching volume 52e6c2d4-ea56-40a1-a79f-d181197ac348
Nov 14 05:54:02 user nova-compute[75469]: INFO nova.virt.block_device [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Attempting to driver detach volume 52e6c2d4-ea56-40a1-a79f-d181197ac348 from mountpoint /dev/vdb
Nov 14 05:54:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Attempting to detach device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the persistent domain config. {{(pid=75469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 05:54:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:54:02 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:54:02 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:54:02 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:54:02 user nova-compute[75469]:   <serial>52e6c2d4-ea56-40a1-a79f-d181197ac348</serial>
Nov 14 05:54:02 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:54:02 user nova-compute[75469]: </disk>
Nov 14 05:54:02 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:54:02 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Successfully detached device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the persistent domain config.
Nov 14 05:54:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the live domain config. {{(pid=75469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 05:54:02 user nova-compute[75469]: DEBUG nova.virt.libvirt.guest [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 05:54:02 user nova-compute[75469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 05:54:02 user nova-compute[75469]:   <source dev="/dev/sdb"/>
Nov 14 05:54:02 user nova-compute[75469]:   <target dev="vdb" bus="virtio"/>
Nov 14 05:54:02 user nova-compute[75469]:   <serial>52e6c2d4-ea56-40a1-a79f-d181197ac348</serial>
Nov 14 05:54:02 user nova-compute[75469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 05:54:02 user nova-compute[75469]: </disk>
Nov 14 05:54:02 user nova-compute[75469]:  {{(pid=75469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 05:54:03 user nova-compute[75469]: DEBUG nova.virt.libvirt.driver [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 05:54:06 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:54:07 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:54:09 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 05:54:09 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] There are 0 instances to clean {{(pid=75469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 05:54:10 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:11 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:54:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:54:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:54:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:54:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:54:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:54:16 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:54:21 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:54:23 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 is timed out.
Nov 14 05:54:23 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Successfully detached device vdb from instance 213f5f75-c34f-41bc-b191-ebca9eb41623 from the live domain config.
Nov 14 05:54:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] calling os-brick to detach iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa72c534b20>, {'target_iqn': 'iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrsYCGIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 05:54:23 user nova-compute[75469]: WARNING os_brick.initiator.connectors.base [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a97c1c-f6cc-4079-8755-03f81b16ff95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 05:54:23 user nova-compute[75469]: No targets found.
Nov 14 05:54:23 user nova-compute[75469]: iSNS:
Nov 14 05:54:23 user nova-compute[75469]: No targets found.
Nov 14 05:54:23 user nova-compute[75469]: STATIC:
Nov 14 05:54:23 user nova-compute[75469]: Target: iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348
Nov 14 05:54:23 user nova-compute[75469]:         Portal: 172.16.0.220:3260,-1
Nov 14 05:54:23 user nova-compute[75469]:                 Iface Name: default
Nov 14 05:54:23 user nova-compute[75469]: FIRMWARE:
Nov 14 05:54:23 user nova-compute[75469]: No targets found.
Nov 14 05:54:23 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 05:54:23 user nova-compute[75469]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 05:54:23 user nova-compute[75469]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75469) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348', 0)] {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c243188-0033-40c6-9d8a-f2d8431eb45b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf07ed43-5f79-4d48-82ae-d2effb06ad1a]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 (non-flash)\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 (non-flash)
Nov 14 05:54:23 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 (non-flash)
Nov 14 05:54:23 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa72c5ff400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348'): ({'sdb'}, set())}) {{(pid=75469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Removing single pathed devices sdb {{(pid=75469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22d9031-11d3-40ca-98f5-53224c633ef9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[df69d24b-2934-42f7-8085-b194eb928cbf]: (4, ('ok\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Flushing IO for device /dev/sdb {{(pid=75469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5da276-6bd2-4f9b-baf3-72459c9d85e9]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b53dcb3-64f5-48bd-9d16-03cd65f112d5]: (4, ('1', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.linuxscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] SCSI volumes sdb have been removed. {{(pid=75469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348')] {{(pid=75469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7199035-18e4-47bf-99bd-dedf10d22449]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --logout {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dfb4b8-2177-449c-a0d0-04c1a04db79d]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348, portal: 172.16.0.220,3260]
Nov 14 05:54:23 user nova-compute[75469]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348, portal: 172.16.0.220,3260] successful.
Nov 14 05:54:23 user nova-compute[75469]:  stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op delete {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e6c2d4-ea56-40a1-a79f-d181197ac348 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85531) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83eaa99-ffbd-4e6e-ba5f-3e27a44fbb3c]: (4, ('', '')) {{(pid=85531) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.base [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG os_brick.initiator.connectors.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] <== disconnect_volume: return (263ms) None {{(pid=75469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 05:54:23 user nova-compute[75469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Disconnected iSCSI Volume {{(pid=75469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 05:54:24 user nova-compute[75469]: DEBUG nova.objects.instance [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'flavor' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:54:24 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-811c3feb-674f-4aec-80b4-18021dad7c6b tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.573s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:54:26 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:54:27 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:27 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.processutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 05:54:31 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:54:31 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:54:31 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=24.864444732666016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:54:31 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:54:32 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Instance 213f5f75-c34f-41bc-b191-ebca9eb41623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 05:54:32 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:54:32 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:54:32 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:54:32 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:54:32 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:54:32 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:54:36 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:54:41 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:54:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:54:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 05:54:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquired lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 05:54:41 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Forcefully refreshing network info cache for instance {{(pid=75469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 05:54:41 user nova-compute[75469]: DEBUG nova.objects.instance [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lazy-loading 'info_cache' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:54:41 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:54:41 user nova-compute[75469]: DEBUG nova.network.neutron [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating instance_info_cache with network_info: [{"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:54:41 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Releasing lock "refresh_cache-213f5f75-c34f-41bc-b191-ebca9eb41623" {{(pid=75469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 05:54:41 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updated the network info_cache for instance {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 05:54:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:44 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:45 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:46 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:46 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:54:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:54:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:54:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:54:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:54:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:54:46 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:54:47 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:51 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:54:52 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:54 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:54:56 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:55:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:55:04 user nova-compute[75469]: INFO nova.compute.manager [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Terminating instance
Nov 14 05:55:04 user nova-compute[75469]: DEBUG nova.compute.manager [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Start destroying the instance on the hypervisor. {{(pid=75469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-475f5329-1275-4b58-8369-4b32440c26d7 req-1fbb027e-26d6-48f5-a9e6-1c068fb3816a service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Received event network-vif-unplugged-77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-475f5329-1275-4b58-8369-4b32440c26d7 req-1fbb027e-26d6-48f5-a9e6-1c068fb3816a service nova] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-475f5329-1275-4b58-8369-4b32440c26d7 req-1fbb027e-26d6-48f5-a9e6-1c068fb3816a service nova] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-475f5329-1275-4b58-8369-4b32440c26d7 req-1fbb027e-26d6-48f5-a9e6-1c068fb3816a service nova] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-475f5329-1275-4b58-8369-4b32440c26d7 req-1fbb027e-26d6-48f5-a9e6-1c068fb3816a service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] No waiting events found dispatching network-vif-unplugged-77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG nova.compute.manager [req-475f5329-1275-4b58-8369-4b32440c26d7 req-1fbb027e-26d6-48f5-a9e6-1c068fb3816a service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Received event network-vif-unplugged-77acf320-5057-4405-b693-d71a1cff30d9 for instance with task_state deleting. {{(pid=75469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 05:55:04 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:05 user nova-compute[75469]: INFO nova.virt.libvirt.driver [-] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Instance destroyed successfully.
Nov 14 05:55:05 user nova-compute[75469]: DEBUG nova.objects.instance [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lazy-loading 'resources' on Instance uuid 213f5f75-c34f-41bc-b191-ebca9eb41623 {{(pid=75469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG nova.virt.libvirt.vif [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T05:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1731532525',display_name='tempest-SnapshotDataIntegrityTests-server-1731532525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1731532525',id=53,image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEutSWaKDrmpRKeTJLtyjgCxxG2/vrdD3HV54p50XQkNgnKwsoSzmzvKsQp+O/1x2CW5Mv4kaEEgJVf8bb7YByzpoLTwYL2QHcMeIXH4n5G9M6dtX3hHfYWuMsUisTm5bQ==',key_name='tempest-keypair-691528237',keypairs=<?>,launch_index=0,launched_at=2023-11-14T05:49:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bf654e161df49cc8664ae34a33594b6',ramdisk_id='',reservation_id='r-np64q2r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b828d08-5de0-47b5-a30d-5095d166987a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2028869202',owner_user_name='tempest-SnapshotDataIntegrityTests-2028869202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T05:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6c38ad94a574b419bc76754a85dd2b6',uuid=213f5f75-c34f-41bc-b191-ebca9eb41623,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Converting VIF {"id": "77acf320-5057-4405-b693-d71a1cff30d9", "address": "fa:16:3e:cf:c9:1a", "network": {"id": "f2168821-0835-46aa-9739-3285e556165f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949733711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bf654e161df49cc8664ae34a33594b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77acf320-50", "ovs_interfaceid": "77acf320-5057-4405-b693-d71a1cff30d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG nova.network.os_vif_util [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=77acf320-5057-4405-b693-d71a1cff30d9,network=Network(f2168821-0835-46aa-9739-3285e556165f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77acf320-50') {{(pid=75469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG os_vif [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=77acf320-5057-4405-b693-d71a1cff30d9,network=Network(f2168821-0835-46aa-9739-3285e556165f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77acf320-50') {{(pid=75469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77acf320-50, bridge=br-int, if_exists=True) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=834d3763-8635-4ea0-949f-1b7ff2f8e2c0) {{(pid=75469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:55:05 user nova-compute[75469]: INFO os_vif [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=77acf320-5057-4405-b693-d71a1cff30d9,network=Network(f2168821-0835-46aa-9739-3285e556165f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77acf320-50')
Nov 14 05:55:05 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Deleting instance files /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623_del
Nov 14 05:55:05 user nova-compute[75469]: INFO nova.virt.libvirt.driver [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Deletion of /opt/stack/data/nova/instances/213f5f75-c34f-41bc-b191-ebca9eb41623_del complete
Nov 14 05:55:05 user nova-compute[75469]: INFO nova.compute.manager [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 05:55:05 user nova-compute[75469]: DEBUG oslo.service.loopingcall [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG nova.compute.manager [-] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Deallocating network for instance {{(pid=75469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] deallocate_for_instance() {{(pid=75469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 05:55:05 user nova-compute[75469]: DEBUG nova.network.neutron [-] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Updating instance_info_cache with network_info: [] {{(pid=75469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 05:55:06 user nova-compute[75469]: INFO nova.compute.manager [-] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Took 0.64 seconds to deallocate network for instance.
Nov 14 05:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:55:06 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:55:06 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:55:06 user nova-compute[75469]: INFO nova.scheduler.client.report [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Deleted allocations for instance 213f5f75-c34f-41bc-b191-ebca9eb41623
Nov 14 05:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-5e999cfb-b0ac-4da1-878c-b8f892d9f965 tempest-SnapshotDataIntegrityTests-2028869202 tempest-SnapshotDataIntegrityTests-2028869202-project-member] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.902s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:55:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-a519fba4-37fd-45fd-b8d2-cf9c15703175 req-deb1346a-ce03-4b39-86eb-577e18e455a3 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Received event network-vif-plugged-77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a519fba4-37fd-45fd-b8d2-cf9c15703175 req-deb1346a-ce03-4b39-86eb-577e18e455a3 service nova] Acquiring lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a519fba4-37fd-45fd-b8d2-cf9c15703175 req-deb1346a-ce03-4b39-86eb-577e18e455a3 service nova] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:55:06 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [req-a519fba4-37fd-45fd-b8d2-cf9c15703175 req-deb1346a-ce03-4b39-86eb-577e18e455a3 service nova] Lock "213f5f75-c34f-41bc-b191-ebca9eb41623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:55:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-a519fba4-37fd-45fd-b8d2-cf9c15703175 req-deb1346a-ce03-4b39-86eb-577e18e455a3 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] No waiting events found dispatching network-vif-plugged-77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 05:55:06 user nova-compute[75469]: WARNING nova.compute.manager [req-a519fba4-37fd-45fd-b8d2-cf9c15703175 req-deb1346a-ce03-4b39-86eb-577e18e455a3 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Received unexpected event network-vif-plugged-77acf320-5057-4405-b693-d71a1cff30d9 for instance with vm_state deleted and task_state None.
Nov 14 05:55:06 user nova-compute[75469]: DEBUG nova.compute.manager [req-a519fba4-37fd-45fd-b8d2-cf9c15703175 req-deb1346a-ce03-4b39-86eb-577e18e455a3 service nova] [instance: 213f5f75-c34f-41bc-b191-ebca9eb41623] Received event network-vif-deleted-77acf320-5057-4405-b693-d71a1cff30d9 {{(pid=75469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 05:55:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:55:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:55:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 05:55:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:55:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 05:55:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:25 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:30 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Auditing locally available compute resources for user (node: user) {{(pid=75469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 05:55:33 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:55:33 user nova-compute[75469]: WARNING nova.virt.libvirt.driver [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 05:55:33 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Hypervisor/Node resource view: name=user free_ram=9139MB free_disk=24.891624450683594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG nova.compute.provider_tree [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed in ProviderTree for provider: 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 {{(pid=75469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG nova.scheduler.client.report [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Inventory has not changed for provider 96d8ab03-209c-478b-97a4-3b20ae4d0ee4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG nova.compute.resource_tracker [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Compute_service record updated for user:user {{(pid=75469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 05:55:33 user nova-compute[75469]: DEBUG oslo_concurrency.lockutils [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 05:55:35 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:40 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:42 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:55:42 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Starting heal instance info cache {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 05:55:42 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Rebuilding the list of instances to heal {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 05:55:42 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Didn't find any instances for network info cache update. {{(pid=75469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 05:55:43 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:55:45 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:46 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:55:47 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:55:47 user nova-compute[75469]: DEBUG nova.compute.manager [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 05:55:48 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:55:50 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:55:51 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:55:54 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:55:54 user nova-compute[75469]: DEBUG oslo_service.periodic_task [None req-25b967e1-925b-4eac-93c5-361417eb15dd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 05:55:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:55 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:55:58 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:56:00 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:56:01 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:56:05 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:56:10 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 05:56:15 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 05:56:20 user nova-compute[75469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}